Jul 18 01:50:43.103221 ip-10-0-143-37 systemd[1]: Starting Kubernetes Kubelet... Jul 18 01:50:43.471006 ip-10-0-143-37 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 01:50:43.471006 ip-10-0-143-37 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 01:50:43.471006 ip-10-0-143-37 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 01:50:43.471006 ip-10-0-143-37 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 01:50:43.471006 ip-10-0-143-37 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 01:50:43.473485 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.473330 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 01:50:43.478531 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478509 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 01:50:43.478531 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478526 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 01:50:43.478531 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478531 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 01:50:43.478531 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478535 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 01:50:43.478531 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478539 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478548 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478552 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478556 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478560 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478563 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478567 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478570 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478574 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478577 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478581 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478584 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478588 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478592 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478598 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478603 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478607 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478611 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478615 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 01:50:43.478816 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478619 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478623 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478627 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478630 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478637 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478643 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478647 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478652 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478657 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478665 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478669 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478673 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478677 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478682 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478686 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478691 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478696 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478701 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478705 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 01:50:43.479750 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478710 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478714 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478718 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478722 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478726 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478730 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478734 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478740 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478744 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478748 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478752 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478756 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478760 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478764 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478768 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478772 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478777 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478781 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478785 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478789 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 01:50:43.480570 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478793 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478798 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478802 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478806 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478811 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478817 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478822 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478827 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478833 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478838 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478843 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478848 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478852 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478857 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478862 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478866 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478871 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478875 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478879 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478883 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 01:50:43.481418 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478887 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478891 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478895 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.478903 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479004 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479009 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479013 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479018 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479022 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479026 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479031 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479035 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479039 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479043 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479047 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479052 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.479057 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480238 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480250 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 01:50:43.482293 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480256 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480260 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480264 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480277 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480282 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480286 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480291 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480295 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480299 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480303 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480307 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480311 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480316 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480320 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480324 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480328 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480333 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480337 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480341 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480345 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 01:50:43.483128 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480349 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480354 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480358 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480362 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480366 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480372 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480376 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480380 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480384 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480388 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480393 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480397 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480404 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480409 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480414 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480419 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480424 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480428 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480433 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 01:50:43.483798 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480438 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480442 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480447 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480451 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480455 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480459 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480463 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480467 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480471 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480477 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480481 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480485 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480489 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480494 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480498 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480503 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480507 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480511 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480516 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480520 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 01:50:43.484417 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480524 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480528 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480532 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480536 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480541 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480545 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480549 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480553 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480557 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480562 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480566 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480570 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480574 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480581 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480586 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480590 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480594 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480598 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480602 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480606 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 01:50:43.485053 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480610 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480615 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480619 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480623 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480627 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480631 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480635 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480640 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480644 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480649 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480653 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480657 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480661 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480666 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480670 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480674 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480678 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.480682 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481359 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481368 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 01:50:43.485567 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481372 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481376 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481381 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481386 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481390 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481394 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481400 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481404 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481408 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481412 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481416 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481420 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481424 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481428 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481432 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481436 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481440 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481444 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481449 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481454 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 01:50:43.486188 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481458 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481464 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481469 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481473 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481477 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481482 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481486 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481489 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481495 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481502 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481506 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481510 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481514 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481518 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481522 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481527 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481531 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481535 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481539 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481543 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 01:50:43.486665 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481548 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481552 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481556 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481559 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481563 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481568 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481574 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481580 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481586 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481591 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481595 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481600 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481604 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481608 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481612 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481616 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481620 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481626 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481630 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 01:50:43.487241 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481634 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481638 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481642 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481646 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481650 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481654 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481658 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481663 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481667 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481672 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481676 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481680 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481684 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481688 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481692 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481696 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481701 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481705 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481714 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481720 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 01:50:43.487847 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481725 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481731 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481735 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481740 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481744 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481749 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481753 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481758 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481762 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481766 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481770 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481774 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481778 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481782 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481787 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481791 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481795 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.481799 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481899 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481930 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481941 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 01:50:43.488402 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481948 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481955 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481960 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481967 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481973 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481978 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481983 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481988 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.481994 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482001 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482006 2558 flags.go:64] FLAG: --cgroup-root="" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482010 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482016 2558 flags.go:64] FLAG: --client-ca-file="" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482021 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482026 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482032 2558 flags.go:64] FLAG: --cluster-domain="" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482037 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482042 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482047 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482053 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482059 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482064 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482069 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 01:50:43.488929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482074 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482079 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482084 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482088 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482093 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482098 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482104 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482109 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482114 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482118 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482123 2558 flags.go:64] FLAG: --enable-server="true" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482128 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482136 2558 flags.go:64] FLAG: --event-burst="100" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482141 2558 flags.go:64] FLAG: --event-qps="50" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482146 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482151 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482155 2558 flags.go:64] FLAG: --eviction-hard="" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482161 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482167 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482172 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482177 2558 flags.go:64] FLAG: --eviction-soft="" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482183 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482188 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482193 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482197 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 01:50:43.489511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482202 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482206 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482210 2558 flags.go:64] FLAG: --feature-gates="" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482217 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482222 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482227 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482232 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482237 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482241 2558 flags.go:64] FLAG: --help="false" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482246 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482251 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482255 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482260 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482266 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482271 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482275 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482280 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482284 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482289 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482294 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482299 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482303 2558 flags.go:64] FLAG: --kube-reserved="" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482307 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482311 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 01:50:43.490148 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482316 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482326 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482330 2558 flags.go:64] FLAG: --lock-file="" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482335 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482341 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482346 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482355 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482359 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482363 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482368 2558 flags.go:64] FLAG: --logging-format="text" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482373 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482378 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482383 2558 flags.go:64] FLAG: --manifest-url="" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482388 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482395 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482400 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482406 2558 flags.go:64] FLAG: --max-pods="110" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482411 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482416 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482420 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482425 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482429 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482434 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482438 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482450 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 01:50:43.490718 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482455 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482460 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482465 2558 flags.go:64] FLAG: --pod-cidr="" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482470 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482479 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482483 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482488 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482492 2558 flags.go:64] FLAG: --port="10250" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482499 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482504 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c9e1fe490f9d5e5" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482509 2558 flags.go:64] FLAG: --qos-reserved="" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482513 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482519 2558 flags.go:64] FLAG: --register-node="true" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482524 2558 flags.go:64] FLAG: --register-with-taints="" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482530 2558 flags.go:64] FLAG: --registry-burst="10" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482535 2558 flags.go:64] FLAG: --registry-qps="5" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482541 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482546 2558 flags.go:64] FLAG: --reserved-memory="" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482552 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482557 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482562 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482567 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482571 2558 flags.go:64] FLAG: --runonce="false" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482576 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482581 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 01:50:43.491391 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482585 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482590 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482595 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482600 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482604 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482609 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482614 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482618 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482623 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482628 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482632 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482638 2558 flags.go:64] FLAG: --system-cgroups="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482643 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482651 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482655 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482664 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482670 2558 flags.go:64] FLAG: --tls-min-version="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482675 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482679 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482685 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482690 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482695 2558 flags.go:64] FLAG: --v="2" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482701 2558 flags.go:64] FLAG: --version="false" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482707 2558 flags.go:64] FLAG: --vmodule="" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482713 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 01:50:43.492055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.482718 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482927 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482935 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482939 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482944 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482949 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482953 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482957 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482962 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482966 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482969 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482974 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482981 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482987 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482992 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.482997 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483001 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483006 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483011 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483016 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 01:50:43.492680 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483020 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483024 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483030 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483034 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483038 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483042 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483048 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483052 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483056 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483061 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483065 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483069 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483073 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483077 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483081 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483086 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483089 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483094 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483098 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483102 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 01:50:43.493347 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483106 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483110 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483114 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483118 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483123 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483126 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483130 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483134 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483138 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483142 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483146 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483150 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483157 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483163 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483171 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483176 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483180 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483184 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483188 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 01:50:43.494155 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483192 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483196 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483200 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483204 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483208 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483212 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483216 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483220 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483224 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483228 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483232 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483236 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483240 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483244 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483248 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483252 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483256 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483260 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483264 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483268 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 01:50:43.494811 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483272 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483275 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483279 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483284 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483288 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483292 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483297 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483304 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483308 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483312 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483316 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483320 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483324 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483327 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483331 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483335 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483342 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483348 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483352 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483357 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 01:50:43.495433 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.483361 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.483370 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.491332 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.491350 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.492210 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.492221 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492299 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492304 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492306 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492310 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492313 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492316 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492318 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492321 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492323 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 01:50:43.496270 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492326 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492328 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492330 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492333 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492335 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492340 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492344 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492347 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492351 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492353 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492356 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492360 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492363 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492367 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492370 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492373 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492376 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492379 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492381 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 01:50:43.496927 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492384 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492393 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492396 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492399 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492402 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492405 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492407 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492409 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492412 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492415 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492417 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492420 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492423 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492425 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492428 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492430 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492432 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492435 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492437 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492440 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 01:50:43.497447 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492443 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492445 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492447 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492450 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492452 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492455 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492457 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492460 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492462 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492465 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492467 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492470 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492472 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492475 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492484 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492486 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492489 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492492 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492494 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 01:50:43.498094 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492496 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492499 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492501 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492504 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492506 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492508 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492511 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492513 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492515 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492518 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492520 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492522 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492525 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492527 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492530 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492532 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492534 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492537 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492540 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492542 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 01:50:43.498566 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492544 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492547 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492549 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492551 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492554 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492556 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492559 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492562 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492569 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492572 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492574 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492577 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.492582 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492774 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492779 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 01:50:43.499089 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492782 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492785 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492788 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492790 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492793 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492795 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492798 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492801 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492803 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492805 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492808 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492811 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492813 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492816 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492818 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492820 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492823 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492825 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.492827 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493191 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 01:50:43.499499 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493523 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493529 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493534 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493543 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493548 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493553 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493598 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493604 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493608 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493614 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493619 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493630 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493634 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493638 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493645 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493650 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493656 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493662 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493666 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 01:50:43.500041 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493671 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493675 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493680 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493685 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493694 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493698 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493703 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493707 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493711 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493715 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493720 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493725 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493731 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493735 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493739 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493744 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493753 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493757 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493761 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 01:50:43.500561 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493765 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493795 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493800 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493804 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493808 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493813 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493816 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493820 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493824 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493828 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493837 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493841 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493845 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493849 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493853 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493857 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493862 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493865 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493870 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493874 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 01:50:43.501052 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493878 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493883 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493887 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493895 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493900 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493904 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493926 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493930 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493935 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493939 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493943 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493947 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493952 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493956 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.493991 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.494000 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.494004 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.494008 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 01:50:43.501556 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:43.494012 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 01:50:43.502104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.494020 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 01:50:43.502104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.494644 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 01:50:43.502104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.497791 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 01:50:43.502104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.499456 2558 server.go:1019] "Starting client certificate rotation" Jul 18 01:50:43.502104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.499560 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 01:50:43.502104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.499593 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 01:50:43.502553 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.502536 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 01:50:43.503785 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.503766 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 01:50:43.523127 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.523101 2558 log.go:25] "Validated CRI v1 runtime API" Jul 18 01:50:43.525528 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.525504 2558 log.go:25] "Validated CRI v1 image API" Jul 18 01:50:43.526359 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.526342 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 01:50:43.526543 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.526528 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 01:50:43.532693 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.532666 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 89adee7d-dba1-4b42-8e56-ef769d5283f7:/dev/nvme0n1p4 c2ec6087-f3e2-4e0d-999f-b241bad2058d:/dev/nvme0n1p3] Jul 18 01:50:43.532772 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.532694 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 01:50:43.538830 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.538687 2558 manager.go:216] Machine: {Timestamp:2026-07-18 01:50:43.537374636 +0000 UTC m=+0.323726693 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092799 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24bd34f0e74012b75d9bff1c3bd72c SystemUUID:ec24bd34-f0e7-4012-b75d-9bff1c3bd72c BootID:8180ffad-2dc2-4775-b757-9f714e6ec595 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:eb:5b:9c:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:eb:5b:9c:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:0e:e2:6f:71:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 01:50:43.538830 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.538824 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 01:50:43.538960 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.538930 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 01:50:43.540692 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.540667 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 01:50:43.540831 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.540695 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 01:50:43.541539 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.541528 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 01:50:43.541579 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.541541 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 01:50:43.541579 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.541548 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 01:50:43.542413 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.542402 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 01:50:43.544490 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.544478 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 01:50:43.546387 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.546370 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8qdg" Jul 18 01:50:43.548094 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548081 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 18 01:50:43.548228 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548218 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 01:50:43.548262 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548249 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 18 01:50:43.548292 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548263 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 01:50:43.548292 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548278 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 01:50:43.548292 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548289 2558 kubelet.go:398] "Adding apiserver pod source" Jul 18 01:50:43.548380 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548297 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 01:50:43.548787 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548774 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 01:50:43.548833 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.548795 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 01:50:43.552800 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.552777 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 01:50:43.553279 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.553257 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8qdg" Jul 18 01:50:43.555220 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.555206 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 01:50:43.555289 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.555236 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 01:50:43.556680 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556667 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 01:50:43.556729 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556690 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 01:50:43.556729 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556700 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 01:50:43.556729 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556708 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 01:50:43.556729 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556722 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556732 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556742 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556748 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556755 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556761 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556769 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556774 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556797 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 01:50:43.556846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.556806 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 01:50:43.558975 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.558949 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 01:50:43.559079 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.559060 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 01:50:43.559117 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.559094 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 01:50:43.560485 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.560474 2558 server.go:1268] "Started kubelet" Jul 18 01:50:43.560608 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.560543 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 01:50:43.560608 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.560576 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 01:50:43.560737 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.560640 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 01:50:43.561396 ip-10-0-143-37 systemd[1]: Started Kubernetes Kubelet. Jul 18 01:50:43.562138 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.562124 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 01:50:43.563425 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.563406 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 18 01:50:43.567668 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.567647 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 01:50:43.572620 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.572599 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 01:50:43.572620 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.572610 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 01:50:43.572791 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.572775 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:43.573371 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.573351 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 01:50:43.573371 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.573353 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 01:50:43.573521 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.573384 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 01:50:43.573521 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.573473 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 18 01:50:43.573521 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.573484 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 18 01:50:43.574491 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574466 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 01:50:43.574577 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574499 2558 factory.go:55] Registering systemd factory Jul 18 01:50:43.574577 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574512 2558 factory.go:223] Registration of the systemd container factory successfully Jul 18 01:50:43.574745 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574732 2558 factory.go:153] Registering CRI-O factory Jul 18 01:50:43.574806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574747 2558 factory.go:223] Registration of the crio container factory successfully Jul 18 01:50:43.574806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574803 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 01:50:43.574924 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574828 2558 factory.go:103] Registering Raw factory Jul 18 01:50:43.574924 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.574843 2558 manager.go:1196] Started watching for new ooms in manager Jul 18 01:50:43.575523 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.575508 2558 manager.go:349] Starting recovery of all containers Jul 18 01:50:43.577288 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.577162 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.584204 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.584185 2558 manager.go:354] Recovery completed Jul 18 01:50:43.589981 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.589964 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.592448 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.592429 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.592528 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.592459 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.592528 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.592469 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.593041 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593020 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 01:50:43.593041 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593031 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 01:50:43.593125 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593058 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 18 01:50:43.593125 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593041 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.593869 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593855 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.593948 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593880 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.593948 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.593889 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.594207 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.594197 2558 policy_none.go:49] "None policy: Start" Jul 18 01:50:43.594241 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.594212 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 01:50:43.594241 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.594222 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 01:50:43.595212 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.595202 2558 policy_none.go:47] "Start" Jul 18 01:50:43.626522 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.626505 2558 manager.go:337] "Starting Device Plugin manager" Jul 18 01:50:43.626644 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.626543 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 01:50:43.626644 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.626556 2558 server.go:87] "Starting device plugin registration server" Jul 18 01:50:43.626847 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.626831 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 01:50:43.626959 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.626847 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 01:50:43.627027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.626967 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 01:50:43.627076 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.627055 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 01:50:43.627076 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.627064 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 01:50:43.627728 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.627586 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 01:50:43.627801 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.627770 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:43.727303 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.727226 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.727480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.727225 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 01:50:43.728302 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728275 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.728403 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728319 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.728403 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728337 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.728403 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728373 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.728832 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728815 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 01:50:43.728888 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728872 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 01:50:43.728958 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.728898 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 01:50:43.729010 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.728958 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 01:50:43.730634 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.730611 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 01:50:43.738802 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.738782 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.738920 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.738807 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-37.ec2.internal\": node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:43.782214 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.782185 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:43.829280 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.829248 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"] Jul 18 01:50:43.829395 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.829341 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.831306 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.831289 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.831398 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.831322 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.831398 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.831334 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.832707 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.832693 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.832857 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.832842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.832935 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.832879 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.833448 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.833429 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.833520 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.833454 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.833520 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.833468 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.833596 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.833530 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.833596 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.833548 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.833596 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.833558 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.834881 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.834868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.834942 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.834893 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 01:50:43.835706 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.835687 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory" Jul 18 01:50:43.835808 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.835717 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 01:50:43.835808 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.835734 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID" Jul 18 01:50:43.859595 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.859570 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.864112 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.864096 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.875471 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.875453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc0ee09bc9612d45233deacb78a10dc4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"cc0ee09bc9612d45233deacb78a10dc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.875550 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.875478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc0ee09bc9612d45233deacb78a10dc4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"cc0ee09bc9612d45233deacb78a10dc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.875550 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.875496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7806e5900852888ca28273b89b72f3a8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"7806e5900852888ca28273b89b72f3a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.882627 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.882606 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:43.976416 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.976380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc0ee09bc9612d45233deacb78a10dc4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"cc0ee09bc9612d45233deacb78a10dc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.976416 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.976414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc0ee09bc9612d45233deacb78a10dc4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"cc0ee09bc9612d45233deacb78a10dc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.976576 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.976433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7806e5900852888ca28273b89b72f3a8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"7806e5900852888ca28273b89b72f3a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.976576 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.976478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc0ee09bc9612d45233deacb78a10dc4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"cc0ee09bc9612d45233deacb78a10dc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.976576 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.976492 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc0ee09bc9612d45233deacb78a10dc4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"cc0ee09bc9612d45233deacb78a10dc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.976576 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:43.976517 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7806e5900852888ca28273b89b72f3a8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"7806e5900852888ca28273b89b72f3a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" Jul 18 01:50:43.983548 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:43.983484 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.084278 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.084239 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.163475 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.163441 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:44.166315 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.166297 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" Jul 18 01:50:44.184962 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.184927 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.285603 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.285512 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.386043 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.386009 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.486610 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.486578 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.498763 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.498739 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 01:50:44.498895 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.498875 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 01:50:44.498952 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.498902 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 01:50:44.558327 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.558293 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 01:45:43 +0000 UTC" deadline="2028-01-13 09:05:49.948723724 +0000 UTC" Jul 18 01:50:44.558433 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.558328 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13063h15m5.390399836s" Jul 18 01:50:44.587579 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.587540 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.683858 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:44.683820 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7806e5900852888ca28273b89b72f3a8.slice/crio-5c408a777b1516c85d8f57849ef7911a1cb055099f54c8a812a41ebdd85cc3d1 WatchSource:0}: Error finding container 5c408a777b1516c85d8f57849ef7911a1cb055099f54c8a812a41ebdd85cc3d1: Status 404 returned error can't find the container with id 5c408a777b1516c85d8f57849ef7911a1cb055099f54c8a812a41ebdd85cc3d1 Jul 18 01:50:44.684472 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:44.684446 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0ee09bc9612d45233deacb78a10dc4.slice/crio-1e633b76c98f43c37802058f2b49ac56007da4eb7c002597ff354ffe08f41051 WatchSource:0}: Error finding container 1e633b76c98f43c37802058f2b49ac56007da4eb7c002597ff354ffe08f41051: Status 404 returned error can't find the container with id 1e633b76c98f43c37802058f2b49ac56007da4eb7c002597ff354ffe08f41051 Jul 18 01:50:44.687702 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.687685 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.690992 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.690974 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:50:44.692206 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.692189 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 01:50:44.732372 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.732316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"cc0ee09bc9612d45233deacb78a10dc4","Type":"ContainerStarted","Data":"1e633b76c98f43c37802058f2b49ac56007da4eb7c002597ff354ffe08f41051"} Jul 18 01:50:44.733355 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:44.733335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" event={"ID":"7806e5900852888ca28273b89b72f3a8","Type":"ContainerStarted","Data":"5c408a777b1516c85d8f57849ef7911a1cb055099f54c8a812a41ebdd85cc3d1"} Jul 18 01:50:44.787802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.787757 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.888339 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.888266 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:44.988803 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:44.988770 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:45.089716 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.089683 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found" Jul 18 01:50:45.095181 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.095155 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 01:50:45.173354 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.173265 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" Jul 18 01:50:45.184289 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.184127 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 01:50:45.185312 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.185285 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" Jul 18 01:50:45.191295 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.191270 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 01:50:45.306167 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.306138 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 01:50:45.317298 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.317271 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 01:50:45.550172 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.550073 2558 apiserver.go:52] "Watching apiserver" Jul 18 01:50:45.561916 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.561882 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 01:50:45.563278 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.563251 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4pldj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc","openshift-cluster-node-tuning-operator/tuned-hk6dn","openshift-dns/node-resolver-88q8q","openshift-multus/multus-additional-cni-plugins-w44rx","openshift-multus/network-metrics-daemon-szhpx","openshift-network-diagnostics/network-check-target-96h7k","openshift-ovn-kubernetes/ovnkube-node-2cqdp","kube-system/konnectivity-agent-nj9cp","kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal","openshift-image-registry/node-ca-qjq2t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal","openshift-multus/multus-tdpqf","openshift-network-operator/iptables-alerter-cg2ln"] Jul 18 01:50:45.566247 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.566209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:45.566367 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.566301 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:45.569072 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.569041 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.571461 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.571434 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.572330 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.571718 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 01:50:45.572330 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.572011 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.572330 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.572067 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 01:50:45.572330 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.572187 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.572330 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.572320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4k2cq\"" Jul 18 01:50:45.573632 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.573610 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 01:50:45.573735 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.573645 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.573913 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.573894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.574364 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.574019 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.574474 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.574360 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5lgtk\"" Jul 18 01:50:45.575945 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.575922 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.576429 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.576190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.576535 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.576468 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6ttz\"" Jul 18 01:50:45.576535 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.576487 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.578644 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.578621 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:45.578733 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.578697 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:45.579044 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.579005 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 01:50:45.579155 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.579055 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lggf4\"" Jul 18 01:50:45.579218 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.579203 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 01:50:45.581281 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.581010 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.583465 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.583446 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g6b92\"" Jul 18 01:50:45.583576 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.583468 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 01:50:45.583641 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.583590 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.583700 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.583682 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:45.584163 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.584146 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 01:50:45.585512 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysctl-d\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.585619 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysctl-conf\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.585619 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-tuned\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.585619 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:45.585619 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-k8s-cni-cncf-io\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-netns\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-cni-multus\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585760 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-multus-certs\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585777 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151f2a2c-00ae-4a75-a92e-808126f21a59-tmp\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389df2b1-9df6-40ce-a56f-55ca438a7ac9-tmp-dir\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585834 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-cni-bin\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.585859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-conf-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-etc-kubernetes\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-kubernetes\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.585989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-socket-dir-parent\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-hostroot\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-sys\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlp46\" (UniqueName: \"kubernetes.io/projected/151f2a2c-00ae-4a75-a92e-808126f21a59-kube-api-access-tlp46\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-cni-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-os-release\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-run\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfzr\" (UniqueName: \"kubernetes.io/projected/389df2b1-9df6-40ce-a56f-55ca438a7ac9-kube-api-access-mzfzr\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-daemon-config\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvlm\" (UniqueName: \"kubernetes.io/projected/03286a2b-ae6c-4a80-a904-a58d6577a396-kube-api-access-qsvlm\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586283 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-host\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-system-cni-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-kubelet\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/389df2b1-9df6-40ce-a56f-55ca438a7ac9-hosts-file\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-modprobe-d\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysconfig\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586484 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-systemd\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-lib-modules\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-var-lib-kubelet\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-cnibin\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.586900 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.586578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03286a2b-ae6c-4a80-a904-a58d6577a396-cni-binary-copy\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.588273 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.588254 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.588513 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.588494 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mnlgm\"" Jul 18 01:50:45.588682 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.588612 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 01:50:45.588845 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.588825 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.588912 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.588857 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.591157 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.591138 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.591265 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.591167 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 01:50:45.591455 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.591437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.591839 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.591691 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.591839 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.591820 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5z5hx\"" Jul 18 01:50:45.594192 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.594162 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.594301 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.594286 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 01:50:45.594350 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.594333 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.594572 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.594553 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.594733 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.594702 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zxfjb\"" Jul 18 01:50:45.600465 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600443 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 01:50:45.600580 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600474 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 01:50:45.600580 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600536 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4747d\"" Jul 18 01:50:45.600773 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600754 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 01:50:45.601057 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600841 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 01:50:45.601057 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600860 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 01:50:45.601057 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.600847 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 01:50:45.603312 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.603289 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbjd5" Jul 18 01:50:45.611174 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.611155 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbjd5" Jul 18 01:50:45.674683 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.674650 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 01:50:45.687471 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:45.687657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687480 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-run\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.687657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfzr\" (UniqueName: \"kubernetes.io/projected/389df2b1-9df6-40ce-a56f-55ca438a7ac9-kube-api-access-mzfzr\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.687657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-daemon-config\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.687657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvlm\" (UniqueName: \"kubernetes.io/projected/03286a2b-ae6c-4a80-a904-a58d6577a396-kube-api-access-qsvlm\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.687657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-slash\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.687926 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687670 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.687926 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687684 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-run\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.687926 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-host\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.687926 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-system-cni-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.687926 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687814 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-host\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687949 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-system-cni-dir\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.687983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-run-netns\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-var-lib-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688039 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-system-cni-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzd8\" (UniqueName: \"kubernetes.io/projected/69126e0f-b661-4bcd-82ac-e2bd449a7d14-kube-api-access-ckzd8\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688094 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clg4l\" (UniqueName: \"kubernetes.io/projected/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-kube-api-access-clg4l\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688120 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/389df2b1-9df6-40ce-a56f-55ca438a7ac9-hosts-file\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-cni-netd\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.688211 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/389df2b1-9df6-40ce-a56f-55ca438a7ac9-hosts-file\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysconfig\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-systemd\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-lib-modules\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-multus-certs\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688349 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d22e758-50ad-4cc5-8311-4382fe4b8669-serviceca\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysctl-conf\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688394 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysconfig\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688411 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-daemon-config\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-log-socket\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/05453785-8d74-4daf-b7ed-f144e8b72adc-ovn-node-metrics-cert\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688499 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-multus-certs\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc825f9e-f2e7-4396-82df-23a1a8a56b29-agent-certs\") pod \"konnectivity-agent-nj9cp\" (UID: \"cc825f9e-f2e7-4396-82df-23a1a8a56b29\") " pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688349 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-systemd\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.688806 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688540 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-lib-modules\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-kubelet-config\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688602 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-sys-fs\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysctl-conf\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757q5\" (UniqueName: \"kubernetes.io/projected/1d22e758-50ad-4cc5-8311-4382fe4b8669-kube-api-access-757q5\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-socket-dir-parent\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688825 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-socket-dir-parent\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-device-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5s65\" (UniqueName: \"kubernetes.io/projected/05453785-8d74-4daf-b7ed-f144e8b72adc-kube-api-access-z5s65\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d22e758-50ad-4cc5-8311-4382fe4b8669-host\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.688996 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-ovn\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-ovnkube-config\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cni-binary-copy\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689077 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.689654 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-systemd\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-host-slash\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-kubelet\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-ovnkube-script-lib\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cnibin\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689218 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-kubelet\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb6zg\" (UniqueName: \"kubernetes.io/projected/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-kube-api-access-kb6zg\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-kubelet\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-systemd-units\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-cni-bin\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-iptables-alerter-script\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-modprobe-d\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-var-lib-kubelet\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689415 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-cnibin\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03286a2b-ae6c-4a80-a904-a58d6577a396-cni-binary-copy\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-k8s-cni-cncf-io\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.690445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689467 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-os-release\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-etc-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689516 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysctl-d\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689519 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-cnibin\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-k8s-cni-cncf-io\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-tuned\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689480 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-modprobe-d\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-netns\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-cni-multus\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689634 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-var-lib-kubelet\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-socket-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689746 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-sysctl-d\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689757 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc825f9e-f2e7-4396-82df-23a1a8a56b29-konnectivity-ca\") pod \"konnectivity-agent-nj9cp\" (UID: \"cc825f9e-f2e7-4396-82df-23a1a8a56b29\") " pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689727 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-run-netns\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151f2a2c-00ae-4a75-a92e-808126f21a59-tmp\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689814 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-cni-multus\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389df2b1-9df6-40ce-a56f-55ca438a7ac9-tmp-dir\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-cni-bin\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-conf-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-etc-kubernetes\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-dbus\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.689970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4c9\" (UniqueName: \"kubernetes.io/projected/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-kube-api-access-8c4c9\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690009 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-host-var-lib-cni-bin\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690025 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-node-log\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-kubernetes\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690080 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-conf-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-hostroot\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690107 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03286a2b-ae6c-4a80-a904-a58d6577a396-cni-binary-copy\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-registration-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690135 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-etc-kubernetes\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-sys\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690217 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-hostroot\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlp46\" (UniqueName: \"kubernetes.io/projected/151f2a2c-00ae-4a75-a92e-808126f21a59-kube-api-access-tlp46\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690254 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-kubernetes\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-cni-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.691795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-os-release\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.692480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690361 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389df2b1-9df6-40ce-a56f-55ca438a7ac9-tmp-dir\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.692480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690374 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-os-release\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.692480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690378 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/151f2a2c-00ae-4a75-a92e-808126f21a59-sys\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.692480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-env-overrides\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.692480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.690681 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03286a2b-ae6c-4a80-a904-a58d6577a396-multus-cni-dir\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.694337 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.694309 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151f2a2c-00ae-4a75-a92e-808126f21a59-tmp\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.694487 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.694473 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/151f2a2c-00ae-4a75-a92e-808126f21a59-etc-tuned\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.699435 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.698199 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:50:45.699435 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.698231 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:50:45.699435 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.698247 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:45.699435 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.698358 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:46.198315271 +0000 UTC m=+2.984667338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:45.701041 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.701016 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfzr\" (UniqueName: \"kubernetes.io/projected/389df2b1-9df6-40ce-a56f-55ca438a7ac9-kube-api-access-mzfzr\") pod \"node-resolver-88q8q\" (UID: \"389df2b1-9df6-40ce-a56f-55ca438a7ac9\") " pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.701209 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.701041 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvlm\" (UniqueName: \"kubernetes.io/projected/03286a2b-ae6c-4a80-a904-a58d6577a396-kube-api-access-qsvlm\") pod \"multus-tdpqf\" (UID: \"03286a2b-ae6c-4a80-a904-a58d6577a396\") " pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.701209 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.701186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlp46\" (UniqueName: \"kubernetes.io/projected/151f2a2c-00ae-4a75-a92e-808126f21a59-kube-api-access-tlp46\") pod \"tuned-hk6dn\" (UID: \"151f2a2c-00ae-4a75-a92e-808126f21a59\") " pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.791186 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cni-binary-copy\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.791186 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-systemd\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-host-slash\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-ovnkube-script-lib\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791290 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cnibin\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791318 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-systemd\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791347 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-host-slash\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb6zg\" (UniqueName: \"kubernetes.io/projected/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-kube-api-access-kb6zg\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791371 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-kubelet\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-systemd-units\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791427 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cnibin\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.791450 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-kubelet\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791471 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-systemd-units\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-cni-bin\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-iptables-alerter-script\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-os-release\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-etc-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791595 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-cni-bin\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791619 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791637 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-etc-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-socket-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc825f9e-f2e7-4396-82df-23a1a8a56b29-konnectivity-ca\") pod \"konnectivity-agent-nj9cp\" (UID: \"cc825f9e-f2e7-4396-82df-23a1a8a56b29\") " pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-os-release\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-dbus\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4c9\" (UniqueName: \"kubernetes.io/projected/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-kube-api-access-8c4c9\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-node-log\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-registration-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.792151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-env-overrides\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791828 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cni-binary-copy\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-slash\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-system-cni-dir\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-run-netns\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-var-lib-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792016 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-iptables-alerter-script\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792027 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-ovnkube-script-lib\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792032 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzd8\" (UniqueName: \"kubernetes.io/projected/69126e0f-b661-4bcd-82ac-e2bd449a7d14-kube-api-access-ckzd8\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.791832 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-socket-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clg4l\" (UniqueName: \"kubernetes.io/projected/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-kube-api-access-clg4l\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792086 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-slash\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792145 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-run-netns\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792165 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-dbus\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.793087 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792219 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-system-cni-dir\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-cni-netd\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792285 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-node-log\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792335 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-registration-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d22e758-50ad-4cc5-8311-4382fe4b8669-serviceca\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-var-lib-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792379 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc825f9e-f2e7-4396-82df-23a1a8a56b29-konnectivity-ca\") pod \"konnectivity-agent-nj9cp\" (UID: \"cc825f9e-f2e7-4396-82df-23a1a8a56b29\") " pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-log-socket\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/05453785-8d74-4daf-b7ed-f144e8b72adc-ovn-node-metrics-cert\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.792456 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc825f9e-f2e7-4396-82df-23a1a8a56b29-agent-certs\") pod \"konnectivity-agent-nj9cp\" (UID: \"cc825f9e-f2e7-4396-82df-23a1a8a56b29\") " pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792510 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-kubelet-config\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.793755 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792548 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-openvswitch\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-sys-fs\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792561 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-env-overrides\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-757q5\" (UniqueName: \"kubernetes.io/projected/1d22e758-50ad-4cc5-8311-4382fe4b8669-kube-api-access-757q5\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792593 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-cni-netd\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-device-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5s65\" (UniqueName: \"kubernetes.io/projected/05453785-8d74-4daf-b7ed-f144e8b72adc-kube-api-access-z5s65\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.792644 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d22e758-50ad-4cc5-8311-4382fe4b8669-host\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-ovn\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.792706 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:46.292686705 +0000 UTC m=+3.079038756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792725 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-run-ovn\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-ovnkube-config\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792732 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-log-socket\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792773 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-device-dir\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792546 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.794481 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:45.792802 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:46.292783113 +0000 UTC m=+3.079135160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792817 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-sys-fs\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792849 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05453785-8d74-4daf-b7ed-f144e8b72adc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792704 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-kubelet-config\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.792909 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d22e758-50ad-4cc5-8311-4382fe4b8669-host\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.793075 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d22e758-50ad-4cc5-8311-4382fe4b8669-serviceca\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.793278 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/05453785-8d74-4daf-b7ed-f144e8b72adc-ovnkube-config\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.795153 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.793316 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.796121 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.796098 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/05453785-8d74-4daf-b7ed-f144e8b72adc-ovn-node-metrics-cert\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.796273 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.796254 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc825f9e-f2e7-4396-82df-23a1a8a56b29-agent-certs\") pod \"konnectivity-agent-nj9cp\" (UID: \"cc825f9e-f2e7-4396-82df-23a1a8a56b29\") " pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.803804 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.803742 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb6zg\" (UniqueName: \"kubernetes.io/projected/7f4a7004-fff5-4836-8d76-3dc9d5b1df07-kube-api-access-kb6zg\") pod \"multus-additional-cni-plugins-w44rx\" (UID: \"7f4a7004-fff5-4836-8d76-3dc9d5b1df07\") " pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.807443 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.807362 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-757q5\" (UniqueName: \"kubernetes.io/projected/1d22e758-50ad-4cc5-8311-4382fe4b8669-kube-api-access-757q5\") pod \"node-ca-qjq2t\" (UID: \"1d22e758-50ad-4cc5-8311-4382fe4b8669\") " pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.807443 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.807393 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4c9\" (UniqueName: \"kubernetes.io/projected/8d2fbcba-8a2a-449a-98de-eae49f8f2c8b-kube-api-access-8c4c9\") pod \"aws-ebs-csi-driver-node-kr7qc\" (UID: \"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.808184 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.808164 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clg4l\" (UniqueName: \"kubernetes.io/projected/4c82c6b8-be5f-4b1c-aa8d-543da3efdaac-kube-api-access-clg4l\") pod \"iptables-alerter-cg2ln\" (UID: \"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac\") " pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.808738 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.808708 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5s65\" (UniqueName: \"kubernetes.io/projected/05453785-8d74-4daf-b7ed-f144e8b72adc-kube-api-access-z5s65\") pod \"ovnkube-node-2cqdp\" (UID: \"05453785-8d74-4daf-b7ed-f144e8b72adc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:45.808842 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.808739 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzd8\" (UniqueName: \"kubernetes.io/projected/69126e0f-b661-4bcd-82ac-e2bd449a7d14-kube-api-access-ckzd8\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:45.882934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.882890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tdpqf" Jul 18 01:50:45.890246 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.890217 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" Jul 18 01:50:45.901181 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.901141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-88q8q" Jul 18 01:50:45.907143 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.907122 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w44rx" Jul 18 01:50:45.914798 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.914774 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:50:45.921747 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.921725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" Jul 18 01:50:45.930608 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.930585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cg2ln" Jul 18 01:50:45.938790 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.938771 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjq2t" Jul 18 01:50:45.944809 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:45.944788 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:50:46.297209 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.297119 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:46.297209 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.297185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.297220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297311 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297335 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297363 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297381 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297397 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297400 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:47.297378995 +0000 UTC m=+4.083731041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:46.297422 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297421 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:47.297409891 +0000 UTC m=+4.083761936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:46.297767 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.297453 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:47.297432887 +0000 UTC m=+4.083784952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:46.615282 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.615167 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:45:46 +0000 UTC" deadline="2028-03-19 23:11:35.077693616 +0000 UTC" Jul 18 01:50:46.615282 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.615236 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14661h20m48.462467867s" Jul 18 01:50:46.660635 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.660600 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05453785_8d74_4daf_b7ed_f144e8b72adc.slice/crio-796ab63d35590d9e08591d97f9fb0e1e79653f373b2d8adabe06629aee65816e WatchSource:0}: Error finding container 796ab63d35590d9e08591d97f9fb0e1e79653f373b2d8adabe06629aee65816e: Status 404 returned error can't find the container with id 796ab63d35590d9e08591d97f9fb0e1e79653f373b2d8adabe06629aee65816e Jul 18 01:50:46.662615 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.662586 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc825f9e_f2e7_4396_82df_23a1a8a56b29.slice/crio-22d38ac3f1b4a9105de4e13f034a77659d9b87ed264140c93adc089b0b136da1 WatchSource:0}: Error finding container 22d38ac3f1b4a9105de4e13f034a77659d9b87ed264140c93adc089b0b136da1: Status 404 returned error can't find the container with id 22d38ac3f1b4a9105de4e13f034a77659d9b87ed264140c93adc089b0b136da1 Jul 18 01:50:46.666663 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.666638 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03286a2b_ae6c_4a80_a904_a58d6577a396.slice/crio-d1af10cfcc0de1abd23f9731bb13b408a1c68576a23ce09cf52bd7683961f51e WatchSource:0}: Error finding container d1af10cfcc0de1abd23f9731bb13b408a1c68576a23ce09cf52bd7683961f51e: Status 404 returned error can't find the container with id d1af10cfcc0de1abd23f9731bb13b408a1c68576a23ce09cf52bd7683961f51e Jul 18 01:50:46.667278 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.667253 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4a7004_fff5_4836_8d76_3dc9d5b1df07.slice/crio-fda3484e0755935e775f48a5a084da0466fab69070bf48f8834d552b232a56fe WatchSource:0}: Error finding container fda3484e0755935e775f48a5a084da0466fab69070bf48f8834d552b232a56fe: Status 404 returned error can't find the container with id fda3484e0755935e775f48a5a084da0466fab69070bf48f8834d552b232a56fe Jul 18 01:50:46.668894 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.668864 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d22e758_50ad_4cc5_8311_4382fe4b8669.slice/crio-7d0a15e028f430bf48451f7cc09c590d88cd24e337aa7c0ff8d02ff2ba25a532 WatchSource:0}: Error finding container 7d0a15e028f430bf48451f7cc09c590d88cd24e337aa7c0ff8d02ff2ba25a532: Status 404 returned error can't find the container with id 7d0a15e028f430bf48451f7cc09c590d88cd24e337aa7c0ff8d02ff2ba25a532 Jul 18 01:50:46.669303 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.669280 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389df2b1_9df6_40ce_a56f_55ca438a7ac9.slice/crio-d5739c06110148f05adde0349986fe62ebce4c1f800d61196d232127528a4200 WatchSource:0}: Error finding container d5739c06110148f05adde0349986fe62ebce4c1f800d61196d232127528a4200: Status 404 returned error can't find the container with id d5739c06110148f05adde0349986fe62ebce4c1f800d61196d232127528a4200 Jul 18 01:50:46.670972 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.670289 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c82c6b8_be5f_4b1c_aa8d_543da3efdaac.slice/crio-4916a9a8f6487a4d6b639981411e5befb4d4c8c823ba73c603ffc2b088911f42 WatchSource:0}: Error finding container 4916a9a8f6487a4d6b639981411e5befb4d4c8c823ba73c603ffc2b088911f42: Status 404 returned error can't find the container with id 4916a9a8f6487a4d6b639981411e5befb4d4c8c823ba73c603ffc2b088911f42 Jul 18 01:50:46.671559 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.671430 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2fbcba_8a2a_449a_98de_eae49f8f2c8b.slice/crio-09f44f9acf7d382cdbddcf07851ef8ff84ed506295794fb0b50e4f043cd2f5c1 WatchSource:0}: Error finding container 09f44f9acf7d382cdbddcf07851ef8ff84ed506295794fb0b50e4f043cd2f5c1: Status 404 returned error can't find the container with id 09f44f9acf7d382cdbddcf07851ef8ff84ed506295794fb0b50e4f043cd2f5c1 Jul 18 01:50:46.673395 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:50:46.673370 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151f2a2c_00ae_4a75_a92e_808126f21a59.slice/crio-7cd57be1e6bb51ce3d379c6f4c4cc10d49e5e5073d9498b4f6106d3b8ab46ff9 WatchSource:0}: Error finding container 7cd57be1e6bb51ce3d379c6f4c4cc10d49e5e5073d9498b4f6106d3b8ab46ff9: Status 404 returned error can't find the container with id 7cd57be1e6bb51ce3d379c6f4c4cc10d49e5e5073d9498b4f6106d3b8ab46ff9 Jul 18 01:50:46.729515 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.729487 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:46.729630 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.729495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:46.729753 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.729733 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:46.729810 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:46.729596 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:46.740822 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.740785 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerStarted","Data":"fda3484e0755935e775f48a5a084da0466fab69070bf48f8834d552b232a56fe"} Jul 18 01:50:46.741978 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.741954 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" event={"ID":"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b","Type":"ContainerStarted","Data":"09f44f9acf7d382cdbddcf07851ef8ff84ed506295794fb0b50e4f043cd2f5c1"} Jul 18 01:50:46.743268 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.743243 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cg2ln" event={"ID":"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac","Type":"ContainerStarted","Data":"4916a9a8f6487a4d6b639981411e5befb4d4c8c823ba73c603ffc2b088911f42"} Jul 18 01:50:46.744413 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.744385 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" event={"ID":"151f2a2c-00ae-4a75-a92e-808126f21a59","Type":"ContainerStarted","Data":"7cd57be1e6bb51ce3d379c6f4c4cc10d49e5e5073d9498b4f6106d3b8ab46ff9"} Jul 18 01:50:46.745639 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.745610 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tdpqf" event={"ID":"03286a2b-ae6c-4a80-a904-a58d6577a396","Type":"ContainerStarted","Data":"d1af10cfcc0de1abd23f9731bb13b408a1c68576a23ce09cf52bd7683961f51e"} Jul 18 01:50:46.746800 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.746777 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nj9cp" event={"ID":"cc825f9e-f2e7-4396-82df-23a1a8a56b29","Type":"ContainerStarted","Data":"22d38ac3f1b4a9105de4e13f034a77659d9b87ed264140c93adc089b0b136da1"} Jul 18 01:50:46.747978 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.747955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-88q8q" event={"ID":"389df2b1-9df6-40ce-a56f-55ca438a7ac9","Type":"ContainerStarted","Data":"d5739c06110148f05adde0349986fe62ebce4c1f800d61196d232127528a4200"} Jul 18 01:50:46.749270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.749246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjq2t" event={"ID":"1d22e758-50ad-4cc5-8311-4382fe4b8669","Type":"ContainerStarted","Data":"7d0a15e028f430bf48451f7cc09c590d88cd24e337aa7c0ff8d02ff2ba25a532"} Jul 18 01:50:46.750561 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:46.750538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"796ab63d35590d9e08591d97f9fb0e1e79653f373b2d8adabe06629aee65816e"} Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.308194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.308522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.308560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.308747 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.308767 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.308780 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.308844 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:49.308824517 +0000 UTC m=+6.095176563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.309332 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.309385 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:49.309368898 +0000 UTC m=+6.095720949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.309449 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:47.309616 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.309482 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:49.309470459 +0000 UTC m=+6.095822512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:47.616083 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.615941 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:45:46 +0000 UTC" deadline="2027-12-21 08:56:24.922578229 +0000 UTC" Jul 18 01:50:47.616083 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.616017 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12511h5m37.306567323s" Jul 18 01:50:47.729628 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.729581 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:47.729819 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:47.729744 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:47.785627 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.784549 2558 generic.go:356] "Generic (PLEG): container finished" podID="cc0ee09bc9612d45233deacb78a10dc4" containerID="09601465efc6241c1a1d29463efd5c238331faaa1729e30516a25c3e988c2892" exitCode=0 Jul 18 01:50:47.785627 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.784682 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"cc0ee09bc9612d45233deacb78a10dc4","Type":"ContainerDied","Data":"09601465efc6241c1a1d29463efd5c238331faaa1729e30516a25c3e988c2892"} Jul 18 01:50:47.795992 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.795938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" event={"ID":"7806e5900852888ca28273b89b72f3a8","Type":"ContainerStarted","Data":"98caacde2412be586bb602d5c215e365f645212d52d603b1e68ce65fbc52bcdf"} Jul 18 01:50:47.820286 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:47.820213 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" podStartSLOduration=2.820190165 podStartE2EDuration="2.820190165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:47.819078533 +0000 UTC m=+4.605430604" watchObservedRunningTime="2026-07-18 01:50:47.820190165 +0000 UTC m=+4.606542237" Jul 18 01:50:48.729608 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:48.729568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:48.730141 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:48.729706 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:48.730212 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:48.730142 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:48.730297 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:48.730250 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:48.816106 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:48.816059 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"cc0ee09bc9612d45233deacb78a10dc4","Type":"ContainerStarted","Data":"7a6ba0fafdbe7dfd0c2107adbc7270452fc018fd12f70d3c5284e9b2b6814765"} Jul 18 01:50:49.325769 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:49.325730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:49.325972 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:49.325799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:49.325972 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:49.325827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:49.326106 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326045 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:50:49.326106 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326066 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:50:49.326106 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326081 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:49.326257 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326148 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:53.326125663 +0000 UTC m=+10.112477730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:49.326648 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326617 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:49.326765 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326683 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:53.326665199 +0000 UTC m=+10.113017245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:49.326765 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326751 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:49.326883 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.326791 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:53.326778782 +0000 UTC m=+10.113130828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:49.730561 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:49.730481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:49.730951 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:49.730640 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:50.729133 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:50.729094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:50.729342 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:50.729243 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:50.729685 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:50.729665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:50.729793 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:50.729771 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:51.731072 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:51.731040 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:51.731517 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:51.731183 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:52.729768 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:52.729666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:52.729959 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:52.729794 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:52.730214 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:52.730187 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:52.730332 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:52.730287 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:53.360286 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:53.360248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:53.360314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:53.360342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360401 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360471 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360491 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360504 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360594 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360476 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:01.360453844 +0000 UTC m=+18.146805890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360639 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:01.360622629 +0000 UTC m=+18.146974678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:50:53.360738 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.360654 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:01.360644819 +0000 UTC m=+18.146996866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:50:53.730524 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:53.730447 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:53.730653 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:53.730578 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:54.729945 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:54.729893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:54.730482 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:54.730083 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:54.730547 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:54.730481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:54.730691 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:54.730635 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:55.729959 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:55.729923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:55.730462 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:55.730078 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:56.730253 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:56.729734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:56.730253 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:56.729763 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:56.730253 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:56.729870 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:56.730253 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:56.730025 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:57.729807 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:57.729771 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:57.730014 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:57.729933 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:50:58.730009 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:58.729974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:50:58.730451 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:58.730025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:50:58.730451 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:58.730085 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:50:58.730451 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:58.730216 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:50:59.729657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:50:59.729620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:50:59.729801 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:50:59.729768 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:00.729374 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:00.729333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:00.729961 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:00.729333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:00.729961 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:00.729453 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:00.729961 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:00.729510 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:01.425531 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:01.425489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:01.425560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:01.425581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425668 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425700 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425718 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425719 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425730 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425744 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:17.425721939 +0000 UTC m=+34.212073987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425781 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:17.425763118 +0000 UTC m=+34.212115166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:51:01.425802 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.425800 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:17.425790381 +0000 UTC m=+34.212142430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:51:01.732517 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:01.732431 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:01.732977 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:01.732545 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:02.730073 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:02.730042 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:02.730279 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:02.730049 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:02.730279 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:02.730170 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:02.730395 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:02.730278 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:03.730954 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:03.730922 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:03.731413 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:03.731039 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:04.729186 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:04.729147 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:04.729375 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:04.729279 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:04.729375 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:04.729315 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:04.729488 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:04.729443 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:05.729427 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:05.729390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:05.729891 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:05.729540 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:06.730094 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.729772 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:06.730724 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.729772 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:06.730724 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:06.730172 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:06.730724 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:06.730234 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:06.858582 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.858550 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f4a7004-fff5-4836-8d76-3dc9d5b1df07" containerID="07c094a8247ebd8f4f69e5f400a1ffee932e475b588e59c439957283d64ee9e2" exitCode=0 Jul 18 01:51:06.858714 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.858639 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerDied","Data":"07c094a8247ebd8f4f69e5f400a1ffee932e475b588e59c439957283d64ee9e2"} Jul 18 01:51:06.860480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.860452 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" event={"ID":"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b","Type":"ContainerStarted","Data":"ff4bf862cfb94cf53a398109f59c76e64062aa6b885dc2b1bd6abfc97dfe4ebf"} Jul 18 01:51:06.862472 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.862416 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" event={"ID":"151f2a2c-00ae-4a75-a92e-808126f21a59","Type":"ContainerStarted","Data":"8e849c2d0194282a5ab79e99172dc347fdb01409b6ddb89f2983c707462d72fb"} Jul 18 01:51:06.863975 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.863951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tdpqf" event={"ID":"03286a2b-ae6c-4a80-a904-a58d6577a396","Type":"ContainerStarted","Data":"18196c02af8de08545a512d1da678c99df0a8fc097d9c6f9ca06a19c27ead109"} Jul 18 01:51:06.866350 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.866325 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nj9cp" event={"ID":"cc825f9e-f2e7-4396-82df-23a1a8a56b29","Type":"ContainerStarted","Data":"902eb88fdf875f94478e482d6b409571f646df157e49c6db2f590655f5b0b7b0"} Jul 18 01:51:06.868114 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.868078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-88q8q" event={"ID":"389df2b1-9df6-40ce-a56f-55ca438a7ac9","Type":"ContainerStarted","Data":"a3f46acbe50d5b4098e4a859291d47b31b59632af768eff6a9f5b07bd5ebb9bc"} Jul 18 01:51:06.869674 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.869638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjq2t" event={"ID":"1d22e758-50ad-4cc5-8311-4382fe4b8669","Type":"ContainerStarted","Data":"a9ef58fa2b719d8c40d2b946e8db84e12568f6f0aa1995c3e90e69d00421337e"} Jul 18 01:51:06.872647 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.872625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"e45142621b5175f680e8035237382303813f530dac8c677c5b5d875b31377598"} Jul 18 01:51:06.872747 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.872697 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"9bd358d9960d8196c6f8412d6d45580b972e99af610560156a6eebb55f5f034e"} Jul 18 01:51:06.872747 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.872734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"70ab32889ea83ae20d85d6e35ddd3428486b2325543d6a978c7e2eb2808228b4"} Jul 18 01:51:06.872872 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.872766 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"74a6e05ac5e25671c6a5b651990c481455517fae9266733d74e06a5231eb6c9a"} Jul 18 01:51:06.872872 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.872821 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"3a4ff31a26356df27291f4270d3179b0d55702143d4b333bd85015722f0d9907"} Jul 18 01:51:06.879075 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.879035 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" podStartSLOduration=21.879017546 podStartE2EDuration="21.879017546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:48.832630448 +0000 UTC m=+5.618982520" watchObservedRunningTime="2026-07-18 01:51:06.879017546 +0000 UTC m=+23.665369611" Jul 18 01:51:06.893607 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.893560 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tdpqf" podStartSLOduration=3.343982309 podStartE2EDuration="22.89352607s" totalImagesPullingTime="19.549543761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:06.892773518 +0000 UTC m=+23.679125586" watchObservedRunningTime="2026-07-18 01:51:06.89352607 +0000 UTC m=+23.679878135" Jul 18 01:51:06.914585 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.914494 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hk6dn" podStartSLOduration=3.433626258 podStartE2EDuration="22.914473523s" totalImagesPullingTime="19.480847265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:06.909533692 +0000 UTC m=+23.695885759" watchObservedRunningTime="2026-07-18 01:51:06.914473523 +0000 UTC m=+23.700825590" Jul 18 01:51:06.923122 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.923069 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nj9cp" podStartSLOduration=3.443388193 podStartE2EDuration="22.923050989s" totalImagesPullingTime="19.479662796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:06.922891028 +0000 UTC m=+23.709243091" watchObservedRunningTime="2026-07-18 01:51:06.923050989 +0000 UTC m=+23.709403070" Jul 18 01:51:06.952147 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.952079 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qjq2t" podStartSLOduration=3.477888932 podStartE2EDuration="22.952056366s" totalImagesPullingTime="19.474167434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:06.95168618 +0000 UTC m=+23.738038245" watchObservedRunningTime="2026-07-18 01:51:06.952056366 +0000 UTC m=+23.738408434" Jul 18 01:51:06.952657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:06.952592 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-88q8q" podStartSLOduration=3.480092575 podStartE2EDuration="22.952578519s" totalImagesPullingTime="19.472485944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:06.937086288 +0000 UTC m=+23.723438353" watchObservedRunningTime="2026-07-18 01:51:06.952578519 +0000 UTC m=+23.738930585" Jul 18 01:51:07.094040 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.094005 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:07.231500 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.231426 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:07.332022 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.331986 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:07.543547 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.543469 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:51:07.544071 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.544043 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:51:07.729788 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.729764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:07.729949 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:07.729874 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:07.737386 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.737362 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 01:51:07.879931 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.879826 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"f5538381dfacbef59fc8698398b24deb911e17fb5ffcea0408a6e53ffa9d7a66"} Jul 18 01:51:07.881592 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.881565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" event={"ID":"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b","Type":"ContainerStarted","Data":"39fec9e8f0a9bbc863b533287f530f14ecc56c912ab498d77cea16f4b43358c5"} Jul 18 01:51:07.882953 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.882928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cg2ln" event={"ID":"4c82c6b8-be5f-4b1c-aa8d-543da3efdaac","Type":"ContainerStarted","Data":"f787be92200708084640cbb3cca4d2103ba396f1b70dcebf2fb5da98149e4a5e"} Jul 18 01:51:07.883597 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.883580 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:51:07.884048 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.884031 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nj9cp" Jul 18 01:51:07.899700 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:07.899643 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cg2ln" podStartSLOduration=4.427520892 podStartE2EDuration="23.899626686s" totalImagesPullingTime="19.472105794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:07.89940996 +0000 UTC m=+24.685762021" watchObservedRunningTime="2026-07-18 01:51:07.899626686 +0000 UTC m=+24.685978755" Jul 18 01:51:08.053929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.053884 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:08.148803 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.148712 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:08.639894 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.639767 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T01:51:07.737380314Z","UUID":"0537f355-3e3c-47f0-b7f2-4955cfa2c348","Handler":null,"Name":"","Endpoint":""} Jul 18 01:51:08.641334 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.641315 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 01:51:08.641455 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.641351 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 01:51:08.730063 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.730026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:08.730240 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.730068 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:08.730240 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:08.730169 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:08.730340 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:08.730278 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:08.886978 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:08.886941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" event={"ID":"8d2fbcba-8a2a-449a-98de-eae49f8f2c8b","Type":"ContainerStarted","Data":"0446c5d467bbbd6ead1fc37f51dda173a9aad008571a9357d91e78da3c84029f"} Jul 18 01:51:09.126692 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:09.126652 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:09.226627 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:09.226519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:09.730207 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:09.730173 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:09.730399 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:09.730302 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:09.894104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:09.894065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"cf5ec21f20c3d228b6d124139d85a162b63a3bac23c94726fdea5654675d3510"} Jul 18 01:51:10.141093 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:10.140992 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:10.243846 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:10.243789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:10.730001 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:10.729965 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:10.730199 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:10.729963 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:10.730199 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:10.730103 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:10.730199 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:10.730160 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:11.730286 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.730137 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:11.730731 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:11.730392 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:11.902132 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.902097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" event={"ID":"05453785-8d74-4daf-b7ed-f144e8b72adc","Type":"ContainerStarted","Data":"500c4abb9f8cd7aa6774e5f824dcb1660734b7ac37ee8498db4a1a029c520844"} Jul 18 01:51:11.902395 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.902342 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:51:11.904311 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.904288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerStarted","Data":"80093787d340e032ac958d2ffdd3351dfc7cc89434cdf1adaa356b2b6022e5ab"} Jul 18 01:51:11.918697 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.918675 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:51:11.929628 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.929582 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr7qc" podStartSLOduration=6.319139416 podStartE2EDuration="27.929568382s" totalImagesPullingTime="21.610428966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:08.902670206 +0000 UTC m=+25.689022273" watchObservedRunningTime="2026-07-18 01:51:11.929568382 +0000 UTC m=+28.715920448" Jul 18 01:51:11.957926 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:11.957864 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" podStartSLOduration=8.398772288 podStartE2EDuration="27.957848249s" totalImagesPullingTime="19.559075961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:11.929198579 +0000 UTC m=+28.715550645" watchObservedRunningTime="2026-07-18 01:51:11.957848249 +0000 UTC m=+28.744200314" Jul 18 01:51:12.368312 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.368128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:12.438319 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.438278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:12.729858 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.729750 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:12.729858 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.729750 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:12.730094 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:12.729875 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:12.730094 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:12.729943 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:12.909214 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.909172 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f4a7004-fff5-4836-8d76-3dc9d5b1df07" containerID="80093787d340e032ac958d2ffdd3351dfc7cc89434cdf1adaa356b2b6022e5ab" exitCode=0 Jul 18 01:51:12.909746 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.909281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerDied","Data":"80093787d340e032ac958d2ffdd3351dfc7cc89434cdf1adaa356b2b6022e5ab"} Jul 18 01:51:12.909798 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.909773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:51:12.909902 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.909848 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:51:12.925842 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:12.925821 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:51:13.532236 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.532177 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:13.577682 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.577651 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4pldj"] Jul 18 01:51:13.577890 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.577766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:13.577890 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:13.577867 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:13.588554 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.588460 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-96h7k"] Jul 18 01:51:13.588707 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.588594 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:13.588799 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:13.588757 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:13.589156 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.589134 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-szhpx"] Jul 18 01:51:13.589328 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.589261 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:13.589436 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:13.589386 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:13.630241 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.630211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:13.692787 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:13.692759 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:14.144178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:14.144144 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:14.729424 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:14.729393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:14.729590 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:14.729504 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:14.915513 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:14.915479 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f4a7004-fff5-4836-8d76-3dc9d5b1df07" containerID="3f227510ad08fe518b4a157c8ab787a9fc630b6cbf85bd332b6aa770ff81a4b3" exitCode=0 Jul 18 01:51:14.915681 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:14.915540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerDied","Data":"3f227510ad08fe518b4a157c8ab787a9fc630b6cbf85bd332b6aa770ff81a4b3"} Jul 18 01:51:15.729324 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:15.729116 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:15.729743 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:15.729132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:15.729743 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:15.729431 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:15.729743 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:15.729531 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:16.729528 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:16.729497 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:16.729999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:16.729613 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:16.923180 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:16.923144 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f4a7004-fff5-4836-8d76-3dc9d5b1df07" containerID="50902ec2c7f06838cc04e4ccfcce97e291bf98a3728104d19e61d745d09ca3cb" exitCode=0 Jul 18 01:51:16.923354 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:16.923203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerDied","Data":"50902ec2c7f06838cc04e4ccfcce97e291bf98a3728104d19e61d745d09ca3cb"} Jul 18 01:51:17.441707 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:17.441620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:17.441707 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:17.441676 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:17.441707 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:17.441702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441780 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441816 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441848 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441863 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:49.441843992 +0000 UTC m=+66.228196036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441868 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441878 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret podName:4d57b1ce-222a-4d3b-86b6-eab154dec7a2 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:49.441871807 +0000 UTC m=+66.228223850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret") pod "global-pull-secret-syncer-4pldj" (UID: "4d57b1ce-222a-4d3b-86b6-eab154dec7a2") : object "kube-system"/"original-pull-secret" not registered Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441881 2558 projected.go:196] Error preparing data for projected volume kube-api-access-ctzqc for pod openshift-network-diagnostics/network-check-target-96h7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:51:17.441999 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.441958 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc podName:ec0ebe83-6652-4ce6-95b5-d885ed2bbec6 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:49.441941902 +0000 UTC m=+66.228293960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctzqc" (UniqueName: "kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc") pod "network-check-target-96h7k" (UID: "ec0ebe83-6652-4ce6-95b5-d885ed2bbec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 01:51:17.729988 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:17.729953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:17.730411 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:17.729956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:17.730411 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.730064 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96h7k" podUID="ec0ebe83-6652-4ce6-95b5-d885ed2bbec6" Jul 18 01:51:17.730411 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:17.730161 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pldj" podUID="4d57b1ce-222a-4d3b-86b6-eab154dec7a2" Jul 18 01:51:18.729323 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:18.729288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:18.729484 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:18.729413 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:51:19.086810 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.086781 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeReady" Jul 18 01:51:19.087208 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.086944 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 01:51:19.125180 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.125140 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9lmgp"] Jul 18 01:51:19.128475 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.128450 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8sh4g"] Jul 18 01:51:19.128614 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.128601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.131383 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.131361 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.132384 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.132365 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 01:51:19.132384 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.132376 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqc6n\"" Jul 18 01:51:19.133005 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.132990 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 01:51:19.134031 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.133925 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 01:51:19.134031 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.133990 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bmfns\"" Jul 18 01:51:19.134031 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.134017 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 01:51:19.134222 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.134146 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 01:51:19.143814 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.143729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9lmgp"] Jul 18 01:51:19.144552 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.144528 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8sh4g"] Jul 18 01:51:19.238530 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.238492 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:19.255253 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.255219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc575c1-b702-446e-bea4-946ef1b61aef-config-volume\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.255416 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.255289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8pvv\" (UniqueName: \"kubernetes.io/projected/6dc575c1-b702-446e-bea4-946ef1b61aef-kube-api-access-j8pvv\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.255416 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.255359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.255416 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.255393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19424578-6287-4c8b-b845-6bbab694b30c-cert\") pod \"ingress-canary-8sh4g\" (UID: \"19424578-6287-4c8b-b845-6bbab694b30c\") " pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.255544 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.255485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc575c1-b702-446e-bea4-946ef1b61aef-tmp-dir\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.255544 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.255519 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z76b\" (UniqueName: \"kubernetes.io/projected/19424578-6287-4c8b-b845-6bbab694b30c-kube-api-access-4z76b\") pod \"ingress-canary-8sh4g\" (UID: \"19424578-6287-4c8b-b845-6bbab694b30c\") " pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.338763 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.338681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:19.356669 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.356636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc575c1-b702-446e-bea4-946ef1b61aef-config-volume\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.356833 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.356713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8pvv\" (UniqueName: \"kubernetes.io/projected/6dc575c1-b702-446e-bea4-946ef1b61aef-kube-api-access-j8pvv\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.356833 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.356744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.356833 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.356779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19424578-6287-4c8b-b845-6bbab694b30c-cert\") pod \"ingress-canary-8sh4g\" (UID: \"19424578-6287-4c8b-b845-6bbab694b30c\") " pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.356833 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.356831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc575c1-b702-446e-bea4-946ef1b61aef-tmp-dir\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.357008 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.356849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z76b\" (UniqueName: \"kubernetes.io/projected/19424578-6287-4c8b-b845-6bbab694b30c-kube-api-access-4z76b\") pod \"ingress-canary-8sh4g\" (UID: \"19424578-6287-4c8b-b845-6bbab694b30c\") " pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.357273 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.357252 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc575c1-b702-446e-bea4-946ef1b61aef-config-volume\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.357544 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.357526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc575c1-b702-446e-bea4-946ef1b61aef-tmp-dir\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.357613 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:19.357598 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:19.357670 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:19.357654 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:51:19.857636982 +0000 UTC m=+36.643989032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:19.362220 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.362196 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19424578-6287-4c8b-b845-6bbab694b30c-cert\") pod \"ingress-canary-8sh4g\" (UID: \"19424578-6287-4c8b-b845-6bbab694b30c\") " pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.364460 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.364435 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8pvv\" (UniqueName: \"kubernetes.io/projected/6dc575c1-b702-446e-bea4-946ef1b61aef-kube-api-access-j8pvv\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.364889 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.364867 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z76b\" (UniqueName: \"kubernetes.io/projected/19424578-6287-4c8b-b845-6bbab694b30c-kube-api-access-4z76b\") pod \"ingress-canary-8sh4g\" (UID: \"19424578-6287-4c8b-b845-6bbab694b30c\") " pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.448543 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.448507 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8sh4g" Jul 18 01:51:19.601495 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.601262 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8sh4g"] Jul 18 01:51:19.605815 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:51:19.605784 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19424578_6287_4c8b_b845_6bbab694b30c.slice/crio-e3677c1e1845cd06412edbcdf19248ccfd92a208f2cddd0ff4c6d1819e85115f WatchSource:0}: Error finding container e3677c1e1845cd06412edbcdf19248ccfd92a208f2cddd0ff4c6d1819e85115f: Status 404 returned error can't find the container with id e3677c1e1845cd06412edbcdf19248ccfd92a208f2cddd0ff4c6d1819e85115f Jul 18 01:51:19.730027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.729995 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:19.731215 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.730779 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:19.732946 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.732718 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 01:51:19.732946 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.732795 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jss5k\"" Jul 18 01:51:19.732946 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.732808 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 01:51:19.733867 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.733849 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 01:51:19.860824 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.860694 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:19.861041 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:19.860876 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:19.861041 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:19.860972 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:51:20.86094914 +0000 UTC m=+37.647301204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:19.935368 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:19.935274 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8sh4g" event={"ID":"19424578-6287-4c8b-b845-6bbab694b30c","Type":"ContainerStarted","Data":"e3677c1e1845cd06412edbcdf19248ccfd92a208f2cddd0ff4c6d1819e85115f"} Jul 18 01:51:20.729273 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:20.729239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:20.732011 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:20.731987 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 01:51:20.732095 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:20.731994 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbznb\"" Jul 18 01:51:20.870217 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:20.870159 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:20.870407 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:20.870357 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:20.870474 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:20.870448 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:51:22.870425891 +0000 UTC m=+39.656777935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:20.915040 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:20.915006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:20.964981 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:20.964946 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:21.943668 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:21.943632 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f4a7004-fff5-4836-8d76-3dc9d5b1df07" containerID="6d5c568f6db761a6e545981e46fb452db6eff5840b7d6f535176886ac699c143" exitCode=0 Jul 18 01:51:21.944151 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:21.943717 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerDied","Data":"6d5c568f6db761a6e545981e46fb452db6eff5840b7d6f535176886ac699c143"} Jul 18 01:51:22.888115 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:22.888071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:22.888318 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:22.888243 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:22.888318 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:22.888306 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:51:26.88828973 +0000 UTC m=+43.674641794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:22.949585 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:22.949550 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f4a7004-fff5-4836-8d76-3dc9d5b1df07" containerID="91d4eff892796a9b61fb80f1e46e385cb62cb9e1447feaea95a64c99930692f3" exitCode=0 Jul 18 01:51:22.949970 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:22.949615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerDied","Data":"91d4eff892796a9b61fb80f1e46e385cb62cb9e1447feaea95a64c99930692f3"} Jul 18 01:51:23.459126 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:23.458952 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:23.560786 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:23.560747 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:23.953295 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:23.953256 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8sh4g" event={"ID":"19424578-6287-4c8b-b845-6bbab694b30c","Type":"ContainerStarted","Data":"4d95d62b151b6ac14274d2a718bde0a03ba781820b8e483f169bcef4f13ddac1"} Jul 18 01:51:23.956445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:23.956419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w44rx" event={"ID":"7f4a7004-fff5-4836-8d76-3dc9d5b1df07","Type":"ContainerStarted","Data":"b19926bab5e0ef8dc5b2a8438be29d05d83f74efa76c53f762fbc497798fc054"} Jul 18 01:51:23.991096 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:23.991052 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8sh4g" podStartSLOduration=1.188190969 podStartE2EDuration="4.991035759s" totalImagesPullingTime="3.80284479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:23.991005795 +0000 UTC m=+40.777357860" watchObservedRunningTime="2026-07-18 01:51:23.991035759 +0000 UTC m=+40.777387829" Jul 18 01:51:24.023266 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:24.023215 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w44rx" podStartSLOduration=9.113460454 podStartE2EDuration="40.023196019s" totalImagesPullingTime="30.909735565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:24.021438507 +0000 UTC m=+40.807790585" watchObservedRunningTime="2026-07-18 01:51:24.023196019 +0000 UTC m=+40.809548085" Jul 18 01:51:24.168877 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:24.168841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:24.262960 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:24.262903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:25.215234 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:25.215194 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:25.271163 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:25.271132 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:25.796290 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:25.796261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:25.848059 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:25.848025 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:26.916165 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:26.916126 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:26.916548 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:26.916239 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:26.916548 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:26.916296 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:51:34.916279582 +0000 UTC m=+51.702631626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:32.527027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:32.526993 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:32.589948 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:32.589902 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:34.974971 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:34.974924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:34.975479 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:34.975095 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:34.975479 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:34.975215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:51:50.975189939 +0000 UTC m=+67.761541985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:44.932235 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:44.932206 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cqdp" Jul 18 01:51:45.078710 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:45.078672 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:45.130250 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:45.130214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:46.164038 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:46.164001 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:46.264480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:46.264442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:46.319898 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:46.319865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:51:49.472630 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.472579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:51:49.472630 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.472641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:49.473172 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.472675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:49.475545 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.475521 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 01:51:49.475622 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.475546 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 01:51:49.475622 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.475573 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 01:51:49.483601 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:49.483574 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 01:51:49.483709 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:49.483650 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:52:53.483628556 +0000 UTC m=+130.269980600 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : secret "metrics-daemon-secret" not found Jul 18 01:51:49.485847 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.485830 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 01:51:49.487466 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.487449 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d57b1ce-222a-4d3b-86b6-eab154dec7a2-original-pull-secret\") pod \"global-pull-secret-syncer-4pldj\" (UID: \"4d57b1ce-222a-4d3b-86b6-eab154dec7a2\") " pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:49.495970 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.495950 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzqc\" (UniqueName: \"kubernetes.io/projected/ec0ebe83-6652-4ce6-95b5-d885ed2bbec6-kube-api-access-ctzqc\") pod \"network-check-target-96h7k\" (UID: \"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6\") " pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:49.745154 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.745067 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jss5k\"" Jul 18 01:51:49.749059 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.749043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pldj" Jul 18 01:51:49.752968 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.752946 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:49.885402 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.885370 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4pldj"] Jul 18 01:51:49.888807 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:51:49.888775 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d57b1ce_222a_4d3b_86b6_eab154dec7a2.slice/crio-f4c02f17924aa89f786b1c75864424fb951526222d349ad8b6fd5931a112e849 WatchSource:0}: Error finding container f4c02f17924aa89f786b1c75864424fb951526222d349ad8b6fd5931a112e849: Status 404 returned error can't find the container with id f4c02f17924aa89f786b1c75864424fb951526222d349ad8b6fd5931a112e849 Jul 18 01:51:49.902357 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:49.902329 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-96h7k"] Jul 18 01:51:49.905218 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:51:49.905191 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0ebe83_6652_4ce6_95b5_d885ed2bbec6.slice/crio-adc09af40d884001bb5b79f135203b350b49463537eec1d2ba204f619856e505 WatchSource:0}: Error finding container adc09af40d884001bb5b79f135203b350b49463537eec1d2ba204f619856e505: Status 404 returned error can't find the container with id adc09af40d884001bb5b79f135203b350b49463537eec1d2ba204f619856e505 Jul 18 01:51:50.018469 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:50.018380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4pldj" event={"ID":"4d57b1ce-222a-4d3b-86b6-eab154dec7a2","Type":"ContainerStarted","Data":"f4c02f17924aa89f786b1c75864424fb951526222d349ad8b6fd5931a112e849"} Jul 18 01:51:50.019459 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:50.019434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-96h7k" event={"ID":"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6","Type":"ContainerStarted","Data":"adc09af40d884001bb5b79f135203b350b49463537eec1d2ba204f619856e505"} Jul 18 01:51:50.983040 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:50.982997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:51:50.983525 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:50.983217 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:51:50.983525 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:51:50.983284 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:52:22.983264565 +0000 UTC m=+99.769616615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:51:55.034419 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:55.034378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4pldj" event={"ID":"4d57b1ce-222a-4d3b-86b6-eab154dec7a2","Type":"ContainerStarted","Data":"07c97f7c01f5471664beb8a2d51df9d8a68ac68c3f8c3d089747a19bd5e4040b"} Jul 18 01:51:55.035860 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:55.035838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-96h7k" event={"ID":"ec0ebe83-6652-4ce6-95b5-d885ed2bbec6","Type":"ContainerStarted","Data":"2adaefcf61144e833f87a69f47e3745bcfb1990595aa720ef783edada0f050e9"} Jul 18 01:51:55.036002 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:55.035962 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:51:55.048230 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:55.048182 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4pldj" podStartSLOduration=66.275573832 podStartE2EDuration="1m11.048165873s" totalImagesPullingTime="4.772592041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:55.048162461 +0000 UTC m=+71.834514527" watchObservedRunningTime="2026-07-18 01:51:55.048165873 +0000 UTC m=+71.834517918" Jul 18 01:51:55.061352 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:51:55.061299 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-96h7k" podStartSLOduration=66.308649638 podStartE2EDuration="1m11.061281187s" totalImagesPullingTime="4.752631549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:55.061095146 +0000 UTC m=+71.847447211" watchObservedRunningTime="2026-07-18 01:51:55.061281187 +0000 UTC m=+71.847633246" Jul 18 01:52:17.368969 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.368936 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt"] Jul 18 01:52:17.372969 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.372944 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.375395 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.375369 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 18 01:52:17.376393 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.376375 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 18 01:52:17.376592 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.376578 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 18 01:52:17.376664 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.376624 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 18 01:52:17.380784 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.380762 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt"] Jul 18 01:52:17.386652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.386628 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c"] Jul 18 01:52:17.389515 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.389500 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.392247 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.392222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 18 01:52:17.392348 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.392260 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 18 01:52:17.393005 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.392978 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 18 01:52:17.393092 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.393018 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 18 01:52:17.400781 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.400759 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c"] Jul 18 01:52:17.474159 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53100a1c-5930-4756-a577-6a466d8a65bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.474159 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl4tp\" (UniqueName: \"kubernetes.io/projected/82a91204-3eac-4b38-a59b-f9bfebffb3b1-kube-api-access-cl4tp\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.474409 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474182 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82a91204-3eac-4b38-a59b-f9bfebffb3b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.474409 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.474409 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.474409 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-ca\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.474550 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a91204-3eac-4b38-a59b-f9bfebffb3b1-tmp\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.474550 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-hub\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.474550 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.474478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvtcn\" (UniqueName: \"kubernetes.io/projected/53100a1c-5930-4756-a577-6a466d8a65bd-kube-api-access-xvtcn\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.574929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.574871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.575027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.574945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.575027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.574969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-ca\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.575027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.574988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a91204-3eac-4b38-a59b-f9bfebffb3b1-tmp\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.575027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-hub\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.575027 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvtcn\" (UniqueName: \"kubernetes.io/projected/53100a1c-5930-4756-a577-6a466d8a65bd-kube-api-access-xvtcn\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.575258 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53100a1c-5930-4756-a577-6a466d8a65bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.575258 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl4tp\" (UniqueName: \"kubernetes.io/projected/82a91204-3eac-4b38-a59b-f9bfebffb3b1-kube-api-access-cl4tp\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.575258 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82a91204-3eac-4b38-a59b-f9bfebffb3b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.575538 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575483 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a91204-3eac-4b38-a59b-f9bfebffb3b1-tmp\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.575854 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.575802 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53100a1c-5930-4756-a577-6a466d8a65bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.577781 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.577754 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.577871 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.577829 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-ca\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.578097 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.578080 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82a91204-3eac-4b38-a59b-f9bfebffb3b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.578500 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.578478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-hub\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.578500 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.578487 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53100a1c-5930-4756-a577-6a466d8a65bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.582867 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.582844 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl4tp\" (UniqueName: \"kubernetes.io/projected/82a91204-3eac-4b38-a59b-f9bfebffb3b1-kube-api-access-cl4tp\") pod \"klusterlet-addon-workmgr-598d5db87c-kklnt\" (UID: \"82a91204-3eac-4b38-a59b-f9bfebffb3b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.583260 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.583239 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvtcn\" (UniqueName: \"kubernetes.io/projected/53100a1c-5930-4756-a577-6a466d8a65bd-kube-api-access-xvtcn\") pod \"cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c\" (UID: \"53100a1c-5930-4756-a577-6a466d8a65bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.682641 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.682554 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:17.709345 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.709319 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:52:17.818857 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.818820 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt"] Jul 18 01:52:17.821606 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:52:17.821568 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a91204_3eac_4b38_a59b_f9bfebffb3b1.slice/crio-bf361c067ebaa9fd587aab2567d22754b7dd1e6a174b1fe4c5695018aa764c5b WatchSource:0}: Error finding container bf361c067ebaa9fd587aab2567d22754b7dd1e6a174b1fe4c5695018aa764c5b: Status 404 returned error can't find the container with id bf361c067ebaa9fd587aab2567d22754b7dd1e6a174b1fe4c5695018aa764c5b Jul 18 01:52:17.841502 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:17.841475 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c"] Jul 18 01:52:17.844742 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:52:17.844703 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53100a1c_5930_4756_a577_6a466d8a65bd.slice/crio-a99cca5124698bfe8a58580222282b2b4db02d66fa08beab9a91e78d4e9abfaf WatchSource:0}: Error finding container a99cca5124698bfe8a58580222282b2b4db02d66fa08beab9a91e78d4e9abfaf: Status 404 returned error can't find the container with id a99cca5124698bfe8a58580222282b2b4db02d66fa08beab9a91e78d4e9abfaf Jul 18 01:52:18.093126 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:18.093089 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" event={"ID":"82a91204-3eac-4b38-a59b-f9bfebffb3b1","Type":"ContainerStarted","Data":"bf361c067ebaa9fd587aab2567d22754b7dd1e6a174b1fe4c5695018aa764c5b"} Jul 18 01:52:18.094114 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:18.094090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" event={"ID":"53100a1c-5930-4756-a577-6a466d8a65bd","Type":"ContainerStarted","Data":"a99cca5124698bfe8a58580222282b2b4db02d66fa08beab9a91e78d4e9abfaf"} Jul 18 01:52:23.017188 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.017154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:52:23.017571 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:52:23.017316 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:52:23.017571 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:52:23.017386 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:53:27.017365271 +0000 UTC m=+163.803717318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:52:23.113611 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.113449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" event={"ID":"53100a1c-5930-4756-a577-6a466d8a65bd","Type":"ContainerStarted","Data":"fba106ab71a26ed1ecc3490b85b9410c497a545f16ec254f6e8cb13706d2c6ef"} Jul 18 01:52:23.113611 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.113502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" event={"ID":"53100a1c-5930-4756-a577-6a466d8a65bd","Type":"ContainerStarted","Data":"23647e07b4f0d93ac8ea302ef35ec52886e321fb9587962cb5e2678bcd567052"} Jul 18 01:52:23.114984 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.114960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" event={"ID":"82a91204-3eac-4b38-a59b-f9bfebffb3b1","Type":"ContainerStarted","Data":"949f8da5186bcb714c6c78bf9226ae1a2facce459997caa9fcbad23a3ad0fc4c"} Jul 18 01:52:23.115183 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.115164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:23.116370 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.116351 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:52:23.131138 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:23.131093 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" podStartSLOduration=0.9952498 podStartE2EDuration="6.131078181s" totalImagesPullingTime="5.135828381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:23.130610568 +0000 UTC m=+99.916962637" watchObservedRunningTime="2026-07-18 01:52:23.131078181 +0000 UTC m=+99.917430248" Jul 18 01:52:24.119957 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:24.119886 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" event={"ID":"53100a1c-5930-4756-a577-6a466d8a65bd","Type":"ContainerStarted","Data":"20633e52c9a28a293a4b8703942264a35022d8712abe40f3ad1900164250024a"} Jul 18 01:52:24.140751 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:24.140699 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" podStartSLOduration=2.030004178 podStartE2EDuration="7.140684306s" totalImagesPullingTime="5.110680128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:24.139933674 +0000 UTC m=+100.926285737" watchObservedRunningTime="2026-07-18 01:52:24.140684306 +0000 UTC m=+100.927036372" Jul 18 01:52:26.041440 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:26.041406 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-96h7k" Jul 18 01:52:53.529702 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:52:53.529656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:52:53.530168 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:52:53.529785 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 01:52:53.530168 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:52:53.529847 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:55.529829666 +0000 UTC m=+252.316181714 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : secret "metrics-daemon-secret" not found Jul 18 01:53:22.140998 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:53:22.140955 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9lmgp" podUID="6dc575c1-b702-446e-bea4-946ef1b61aef" Jul 18 01:53:22.288644 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:53:22.288615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9lmgp" Jul 18 01:53:23.739266 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:53:23.739230 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:53:27.063447 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:53:27.063405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:53:27.063827 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:53:27.063528 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 01:53:27.063827 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:53:27.063590 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls podName:6dc575c1-b702-446e-bea4-946ef1b61aef nodeName:}" failed. No retries permitted until 2026-07-18 01:55:29.06357459 +0000 UTC m=+285.849926633 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls") pod "dns-default-9lmgp" (UID: "6dc575c1-b702-446e-bea4-946ef1b61aef") : secret "dns-default-metrics-tls" not found Jul 18 01:53:34.729713 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:53:34.729681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:54:23.116100 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:23.116054 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" podUID="82a91204-3eac-4b38-a59b-f9bfebffb3b1" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jul 18 01:54:23.461426 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:23.461393 2558 generic.go:356] "Generic (PLEG): container finished" podID="82a91204-3eac-4b38-a59b-f9bfebffb3b1" containerID="949f8da5186bcb714c6c78bf9226ae1a2facce459997caa9fcbad23a3ad0fc4c" exitCode=1 Jul 18 01:54:23.461597 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:23.461437 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" event={"ID":"82a91204-3eac-4b38-a59b-f9bfebffb3b1","Type":"ContainerDied","Data":"949f8da5186bcb714c6c78bf9226ae1a2facce459997caa9fcbad23a3ad0fc4c"} Jul 18 01:54:23.461747 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:23.461733 2558 scope.go:117] "RemoveContainer" containerID="949f8da5186bcb714c6c78bf9226ae1a2facce459997caa9fcbad23a3ad0fc4c" Jul 18 01:54:24.466210 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:24.466176 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" event={"ID":"82a91204-3eac-4b38-a59b-f9bfebffb3b1","Type":"ContainerStarted","Data":"fbbdf016410742021d6443fca921bf59c20fff43690ce0a9c6314c3bd61ac747"} Jul 18 01:54:24.466594 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:24.466399 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:54:24.467021 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:24.467002 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-598d5db87c-kklnt" Jul 18 01:54:49.501149 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:49.501103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:49.582581 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:49.582546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:51.001430 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:51.001395 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:51.067197 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:51.067159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:51.609014 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:51.608978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:51.666289 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:51.666258 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:52.482809 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:52.482780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:52.675961 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:52.675929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:52.858121 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:52.858031 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:53.928618 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.928580 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2c2q6"] Jul 18 01:54:53.931449 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.931432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:53.935021 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.934997 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qnqgm\"" Jul 18 01:54:53.935154 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.934998 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 01:54:53.936647 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.936629 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 01:54:53.939112 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.939090 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 01:54:53.940448 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.940434 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 01:54:53.954333 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.954310 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2c2q6"] Jul 18 01:54:53.957204 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:53.957178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.042867 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.042836 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.071968 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.071938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvl7\" (UniqueName: \"kubernetes.io/projected/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-api-access-psvl7\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.072058 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.071978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.072058 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.072001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.072058 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.072045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/332cc8a8-9c27-48ef-af85-ad8beddf3a04-crio-socket\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.072217 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.072068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/332cc8a8-9c27-48ef-af85-ad8beddf3a04-data-volume\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.145823 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.145788 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.173213 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173184 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvl7\" (UniqueName: \"kubernetes.io/projected/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-api-access-psvl7\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.173343 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.173343 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.173343 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.173309 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 01:54:54.173343 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/332cc8a8-9c27-48ef-af85-ad8beddf3a04-crio-socket\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.173551 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/332cc8a8-9c27-48ef-af85-ad8beddf3a04-data-volume\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.173551 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.173383 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:54.67336765 +0000 UTC m=+251.459719697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : configmap "kube-rbac-proxy" not found Jul 18 01:54:54.173551 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.173403 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 01:54:54.173551 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.173462 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:54.673446083 +0000 UTC m=+251.459798127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : secret "insights-runtime-extractor-tls" not found Jul 18 01:54:54.173551 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173481 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/332cc8a8-9c27-48ef-af85-ad8beddf3a04-crio-socket\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.173778 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.173673 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/332cc8a8-9c27-48ef-af85-ad8beddf3a04-data-volume\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.181765 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.181705 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvl7\" (UniqueName: \"kubernetes.io/projected/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-api-access-psvl7\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.245983 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.245942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.653686 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.653647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.676616 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.676584 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.676773 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.676620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:54.676773 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.676720 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 01:54:54.676773 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.676719 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 01:54:54.676773 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.676770 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:55.67675615 +0000 UTC m=+252.463108193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : secret "insights-runtime-extractor-tls" not found Jul 18 01:54:54.676968 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:54.676795 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:55.67677709 +0000 UTC m=+252.463129134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : configmap "kube-rbac-proxy" not found Jul 18 01:54:54.757461 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.757424 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.878564 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.878532 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:54.973822 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:54.973791 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:55.582539 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:55.582498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:54:55.582749 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:55.582630 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 01:54:55.582749 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:55.582699 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs podName:69126e0f-b661-4bcd-82ac-e2bd449a7d14 nodeName:}" failed. No retries permitted until 2026-07-18 01:56:57.582679299 +0000 UTC m=+374.369031344 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs") pod "network-metrics-daemon-szhpx" (UID: "69126e0f-b661-4bcd-82ac-e2bd449a7d14") : secret "metrics-daemon-secret" not found Jul 18 01:54:55.682956 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:55.682879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:55.682956 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:55.682963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:55.683202 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:55.683010 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 01:54:55.683202 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:55.683075 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:57.683059736 +0000 UTC m=+254.469411780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : configmap "kube-rbac-proxy" not found Jul 18 01:54:55.683202 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:55.683110 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 01:54:55.683202 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:55.683164 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:57.683148882 +0000 UTC m=+254.469500925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : secret "insights-runtime-extractor-tls" not found Jul 18 01:54:55.760447 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:55.760411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:56.465627 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:56.465596 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-88q8q_389df2b1-9df6-40ce-a56f-55ca438a7ac9/dns-node-resolver/0.log" Jul 18 01:54:57.285977 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:57.285943 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:57.503475 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:57.503443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:57.664733 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:57.664659 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjq2t_1d22e758-50ad-4cc5-8311-4382fe4b8669/node-ca/0.log" Jul 18 01:54:57.696881 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:57.696851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:57.697110 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:57.696892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:54:57.697110 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:57.696988 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 01:54:57.697110 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:57.697049 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:01.697032966 +0000 UTC m=+258.483385010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : configmap "kube-rbac-proxy" not found Jul 18 01:54:57.697110 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:57.697058 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 01:54:57.697110 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:54:57.697107 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:01.697092542 +0000 UTC m=+258.483444586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : secret "insights-runtime-extractor-tls" not found Jul 18 01:54:57.952859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:57.952777 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:58.165885 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:58.165858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:58.297343 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:58.297300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:58.353640 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:58.353603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:58.455723 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:58.455683 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:58.469610 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:58.469588 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8sh4g_19424578-6287-4c8b-b845-6bbab694b30c/serve-healthcheck-canary/0.log" Jul 18 01:54:58.656413 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:58.656319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:59.454396 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:59.454357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:54:59.887419 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:54:59.887388 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:00.060885 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:00.060843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:00.158817 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:00.158734 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:00.670204 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:00.670170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:01.058677 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.058648 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:01.454146 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.454065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:01.660800 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.660769 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:01.730586 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.730557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:01.730756 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.730593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:01.730756 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:55:01.730683 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 01:55:01.730756 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:55:01.730692 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 01:55:01.730756 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:55:01.730749 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:09.730733865 +0000 UTC m=+266.517085911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : secret "insights-runtime-extractor-tls" not found Jul 18 01:55:01.730952 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:55:01.730761 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm podName:332cc8a8-9c27-48ef-af85-ad8beddf3a04 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:09.73075473 +0000 UTC m=+266.517106775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2c2q6" (UID: "332cc8a8-9c27-48ef-af85-ad8beddf3a04") : configmap "kube-rbac-proxy" not found Jul 18 01:55:01.851438 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.851399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:01.951508 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:01.951478 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:02.338748 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:02.338716 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:02.452814 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:02.452787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:02.847665 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:02.847631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:03.326735 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:03.326699 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:03.452476 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:03.452441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:03.519839 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:03.519812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:03.658784 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:03.658686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:04.051335 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:04.051305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:04.652949 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:04.652896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:04.853394 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:04.853313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:05.053020 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:05.052991 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:05.454445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:05.454368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:05.653084 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:05.653051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:05.704188 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:05.704162 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:06.246621 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:06.246579 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:06.450337 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:06.450302 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:07.046698 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:07.046623 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:07.479018 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:07.478977 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:07.576481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:07.576434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:07.675903 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:07.675868 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:07.846714 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:07.846632 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:08.051177 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:08.051138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:08.463267 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:08.463230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:08.563770 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:08.563737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:08.956056 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:08.956028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:09.057056 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.057019 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:09.786583 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.786546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:09.786583 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.786579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:09.787067 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.787047 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/332cc8a8-9c27-48ef-af85-ad8beddf3a04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:09.788978 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.788961 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/332cc8a8-9c27-48ef-af85-ad8beddf3a04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2c2q6\" (UID: \"332cc8a8-9c27-48ef-af85-ad8beddf3a04\") " pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:09.840191 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.840143 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2c2q6" Jul 18 01:55:09.966226 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:09.966198 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2c2q6"] Jul 18 01:55:09.969332 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:55:09.969304 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332cc8a8_9c27_48ef_af85_ad8beddf3a04.slice/crio-d1bb9753b26cb74523c541d11ef3e1d9177d589403edfae0f5af125cf9103fc8 WatchSource:0}: Error finding container d1bb9753b26cb74523c541d11ef3e1d9177d589403edfae0f5af125cf9103fc8: Status 404 returned error can't find the container with id d1bb9753b26cb74523c541d11ef3e1d9177d589403edfae0f5af125cf9103fc8 Jul 18 01:55:10.593954 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:10.593893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2c2q6" event={"ID":"332cc8a8-9c27-48ef-af85-ad8beddf3a04","Type":"ContainerStarted","Data":"d1bb9753b26cb74523c541d11ef3e1d9177d589403edfae0f5af125cf9103fc8"} Jul 18 01:55:13.572703 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:13.572654 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:13.691623 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:13.691587 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:15.613854 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:15.613811 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2c2q6" event={"ID":"332cc8a8-9c27-48ef-af85-ad8beddf3a04","Type":"ContainerStarted","Data":"7e766dba8b82afc260ba8597613dbcb563c22589737ceecab7246b2acf4f15e1"} Jul 18 01:55:16.043974 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:16.043927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:16.144852 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:16.144819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:16.348638 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:16.348553 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:16.526633 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:16.526595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:16.578887 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:16.578850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:17.374018 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:17.373974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:17.473554 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:17.473523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:17.578870 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:17.578832 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:17.630425 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:17.630341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:17.734720 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:17.734690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:17.933793 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:17.933713 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:18.113964 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:18.113900 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:18.625739 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:18.625650 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2c2q6" event={"ID":"332cc8a8-9c27-48ef-af85-ad8beddf3a04","Type":"ContainerStarted","Data":"937042c9745213e4f17abed645aa3971a9f180d3761d98d616720e1649e596b2"} Jul 18 01:55:19.108357 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.108323 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc"] Jul 18 01:55:19.111576 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.111553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:19.114603 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.114575 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 18 01:55:19.115922 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.115887 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8jgwf\"" Jul 18 01:55:19.143021 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.142987 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-gfh7b"] Jul 18 01:55:19.146103 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.146071 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc"] Jul 18 01:55:19.146250 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.146080 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:19.148853 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.148828 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-twq95\"" Jul 18 01:55:19.149251 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.149217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 01:55:19.149577 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.149427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 01:55:19.152837 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.152811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8bf91fa4-1ad9-4aa8-ab56-f35204d29b89-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q24qc\" (UID: \"8bf91fa4-1ad9-4aa8-ab56-f35204d29b89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:19.157316 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.157294 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-gfh7b"] Jul 18 01:55:19.232837 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.232787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:19.253420 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.253388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8bf91fa4-1ad9-4aa8-ab56-f35204d29b89-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q24qc\" (UID: \"8bf91fa4-1ad9-4aa8-ab56-f35204d29b89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:19.253597 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.253496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5pz\" (UniqueName: \"kubernetes.io/projected/db2267fc-474a-403e-a122-da141b49a50d-kube-api-access-5b5pz\") pod \"downloads-5bc67dcd46-gfh7b\" (UID: \"db2267fc-474a-403e-a122-da141b49a50d\") " pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:19.256178 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.256154 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8bf91fa4-1ad9-4aa8-ab56-f35204d29b89-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q24qc\" (UID: \"8bf91fa4-1ad9-4aa8-ab56-f35204d29b89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:19.337307 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.337275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:19.354342 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.354305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5pz\" (UniqueName: \"kubernetes.io/projected/db2267fc-474a-403e-a122-da141b49a50d-kube-api-access-5b5pz\") pod \"downloads-5bc67dcd46-gfh7b\" (UID: \"db2267fc-474a-403e-a122-da141b49a50d\") " pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:19.364744 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.364668 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5pz\" (UniqueName: \"kubernetes.io/projected/db2267fc-474a-403e-a122-da141b49a50d-kube-api-access-5b5pz\") pod \"downloads-5bc67dcd46-gfh7b\" (UID: \"db2267fc-474a-403e-a122-da141b49a50d\") " pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:19.422469 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.422435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:19.433747 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.433718 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:19.456873 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.456827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:19.578043 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.577869 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc"] Jul 18 01:55:19.581031 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:55:19.581003 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf91fa4_1ad9_4aa8_ab56_f35204d29b89.slice/crio-5a52c0ef23ead61d23e25bda333b916cf9c62cdf0c325c2981b28d74c5bfe8bb WatchSource:0}: Error finding container 5a52c0ef23ead61d23e25bda333b916cf9c62cdf0c325c2981b28d74c5bfe8bb: Status 404 returned error can't find the container with id 5a52c0ef23ead61d23e25bda333b916cf9c62cdf0c325c2981b28d74c5bfe8bb Jul 18 01:55:19.609705 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.609682 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-gfh7b"] Jul 18 01:55:19.612291 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:55:19.612266 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2267fc_474a_403e_a122_da141b49a50d.slice/crio-c9ff1ae652ff631be91c740e024a14f27b4cfb10d7d3c2eba238fdc29f191f97 WatchSource:0}: Error finding container c9ff1ae652ff631be91c740e024a14f27b4cfb10d7d3c2eba238fdc29f191f97: Status 404 returned error can't find the container with id c9ff1ae652ff631be91c740e024a14f27b4cfb10d7d3c2eba238fdc29f191f97 Jul 18 01:55:19.630657 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.630597 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-gfh7b" event={"ID":"db2267fc-474a-403e-a122-da141b49a50d","Type":"ContainerStarted","Data":"c9ff1ae652ff631be91c740e024a14f27b4cfb10d7d3c2eba238fdc29f191f97"} Jul 18 01:55:19.631857 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:19.631834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" event={"ID":"8bf91fa4-1ad9-4aa8-ab56-f35204d29b89","Type":"ContainerStarted","Data":"5a52c0ef23ead61d23e25bda333b916cf9c62cdf0c325c2981b28d74c5bfe8bb"} Jul 18 01:55:21.174077 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:21.174037 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:21.239366 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:21.239313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:22.643279 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:22.643165 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" event={"ID":"8bf91fa4-1ad9-4aa8-ab56-f35204d29b89","Type":"ContainerStarted","Data":"3c94e6732ab3656e1fb5c2371d28fc47042e7b29ec113f65b5efffe6d0d21886"} Jul 18 01:55:22.643736 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:22.643533 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:22.645895 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:22.645863 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2c2q6" event={"ID":"332cc8a8-9c27-48ef-af85-ad8beddf3a04","Type":"ContainerStarted","Data":"7acff3bf0248ec0835862fd4ce7d25a467b51fe795dd376851a352848352b426"} Jul 18 01:55:22.649060 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:22.649036 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" Jul 18 01:55:22.658555 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:22.658509 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q24qc" podStartSLOduration=0.893767093 podStartE2EDuration="3.658490865s" totalImagesPullingTime="2.764723772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:22.657306941 +0000 UTC m=+279.443659017" watchObservedRunningTime="2026-07-18 01:55:22.658490865 +0000 UTC m=+279.444842933" Jul 18 01:55:22.676035 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:22.675972 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2c2q6" podStartSLOduration=17.399518763 podStartE2EDuration="29.675949699s" totalImagesPullingTime="12.276430936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:54:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:22.674226134 +0000 UTC m=+279.460578199" watchObservedRunningTime="2026-07-18 01:55:22.675949699 +0000 UTC m=+279.462301766" Jul 18 01:55:23.703547 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:23.703499 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:23.764852 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:23.764811 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:25.290125 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:55:25.290083 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9lmgp" podUID="6dc575c1-b702-446e-bea4-946ef1b61aef" Jul 18 01:55:25.564505 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:25.564407 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:25.656185 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:25.656148 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9lmgp" Jul 18 01:55:27.841770 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:27.841686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.004596 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.004533 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.108393 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.108291 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff"] Jul 18 01:55:28.108589 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.108539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.111925 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.111893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.114219 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.114195 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ctq8k"] Jul 18 01:55:28.114607 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.114584 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 18 01:55:28.114723 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.114592 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 18 01:55:28.114901 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.114882 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9jq66\"" Jul 18 01:55:28.115413 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.115390 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 01:55:28.115504 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.115469 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 01:55:28.115780 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.115762 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 01:55:28.117700 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.117683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.120515 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.120493 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 01:55:28.120613 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.120581 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 01:55:28.121317 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.121022 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 01:55:28.121317 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.121297 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2cqq9\"" Jul 18 01:55:28.128528 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.128498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff"] Jul 18 01:55:28.192538 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.192500 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.225843 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.225812 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-tls\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226030 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.225872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa167200-33d2-4b18-adc4-1d5cb0051754-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.226030 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.225937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-textfile\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226030 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.225952 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-wtmp\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226201 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa167200-33d2-4b18-adc4-1d5cb0051754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.226201 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226080 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226303 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa167200-33d2-4b18-adc4-1d5cb0051754-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.226303 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-root\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226303 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-metrics-client-ca\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226439 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trwt\" (UniqueName: \"kubernetes.io/projected/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-kube-api-access-9trwt\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226439 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2fzz\" (UniqueName: \"kubernetes.io/projected/fa167200-33d2-4b18-adc4-1d5cb0051754-kube-api-access-j2fzz\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.226439 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.226439 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.226405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-sys\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.298060 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.298011 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.327096 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-textfile\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327096 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-wtmp\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327327 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa167200-33d2-4b18-adc4-1d5cb0051754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.327327 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327306 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-wtmp\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327437 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327437 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa167200-33d2-4b18-adc4-1d5cb0051754-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.327536 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327429 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-textfile\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327536 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-root\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327536 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-metrics-client-ca\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327536 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trwt\" (UniqueName: \"kubernetes.io/projected/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-kube-api-access-9trwt\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327536 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2fzz\" (UniqueName: \"kubernetes.io/projected/fa167200-33d2-4b18-adc4-1d5cb0051754-kube-api-access-j2fzz\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.327731 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327731 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-root\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327731 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-sys\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327731 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-tls\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.327731 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.327698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa167200-33d2-4b18-adc4-1d5cb0051754-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.328824 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.328125 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.328824 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.328455 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-sys\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.328824 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.328612 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa167200-33d2-4b18-adc4-1d5cb0051754-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.328824 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.328784 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-metrics-client-ca\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.330864 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.330815 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa167200-33d2-4b18-adc4-1d5cb0051754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.331012 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.330891 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa167200-33d2-4b18-adc4-1d5cb0051754-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.331723 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.331659 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-tls\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.331723 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.331685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.336238 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.336212 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trwt\" (UniqueName: \"kubernetes.io/projected/6c9725a2-7e1e-40fd-9e98-1403c7fb978e-kube-api-access-9trwt\") pod \"node-exporter-ctq8k\" (UID: \"6c9725a2-7e1e-40fd-9e98-1403c7fb978e\") " pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.336361 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.336317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2fzz\" (UniqueName: \"kubernetes.io/projected/fa167200-33d2-4b18-adc4-1d5cb0051754-kube-api-access-j2fzz\") pod \"openshift-state-metrics-79f6958cdf-mp7ff\" (UID: \"fa167200-33d2-4b18-adc4-1d5cb0051754\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.392777 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.392672 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.429738 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.429701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" Jul 18 01:55:28.435095 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.435077 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctq8k" Jul 18 01:55:28.447634 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:55:28.447603 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9725a2_7e1e_40fd_9e98_1403c7fb978e.slice/crio-69bd51061223448b3425c0517f53c26a789511990830000cb9c7c907620b131e WatchSource:0}: Error finding container 69bd51061223448b3425c0517f53c26a789511990830000cb9c7c907620b131e: Status 404 returned error can't find the container with id 69bd51061223448b3425c0517f53c26a789511990830000cb9c7c907620b131e Jul 18 01:55:28.526843 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.526428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:28.579143 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.579109 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff"] Jul 18 01:55:28.582461 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:55:28.582433 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa167200_33d2_4b18_adc4_1d5cb0051754.slice/crio-1b7f3b35ed838d4e1e4064f71239aa10aef55c9f5b2099a8ca9eff9281c60a90 WatchSource:0}: Error finding container 1b7f3b35ed838d4e1e4064f71239aa10aef55c9f5b2099a8ca9eff9281c60a90: Status 404 returned error can't find the container with id 1b7f3b35ed838d4e1e4064f71239aa10aef55c9f5b2099a8ca9eff9281c60a90 Jul 18 01:55:28.667719 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.667679 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctq8k" event={"ID":"6c9725a2-7e1e-40fd-9e98-1403c7fb978e","Type":"ContainerStarted","Data":"69bd51061223448b3425c0517f53c26a789511990830000cb9c7c907620b131e"} Jul 18 01:55:28.669420 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.669390 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" event={"ID":"fa167200-33d2-4b18-adc4-1d5cb0051754","Type":"ContainerStarted","Data":"aaa30c37a9493760e65ddaa9dd19b171b0112ebf63ae87357419b2bd9d82dcb9"} Jul 18 01:55:28.669552 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:28.669440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" event={"ID":"fa167200-33d2-4b18-adc4-1d5cb0051754","Type":"ContainerStarted","Data":"1b7f3b35ed838d4e1e4064f71239aa10aef55c9f5b2099a8ca9eff9281c60a90"} Jul 18 01:55:29.065232 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.065198 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:29.134512 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.134462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:55:29.137463 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.137415 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc575c1-b702-446e-bea4-946ef1b61aef-metrics-tls\") pod \"dns-default-9lmgp\" (UID: \"6dc575c1-b702-446e-bea4-946ef1b61aef\") " pod="openshift-dns/dns-default-9lmgp" Jul 18 01:55:29.139226 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.139185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:29.259544 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.259509 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqc6n\"" Jul 18 01:55:29.267553 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.267524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9lmgp" Jul 18 01:55:29.480066 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:29.480021 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:30.755744 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:30.755697 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:30.854032 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:30.853969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:31.002820 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:31.002780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:31.130891 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:31.130812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:31.217932 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:31.217877 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:31.375259 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:31.375191 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:32.861701 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:32.861658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:32.925568 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:32.925501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:33.395411 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:33.395378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:34.297464 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:34.297404 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:34.376949 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:34.376888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:34.443114 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:34.443079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:35.699709 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:35.699657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" event={"ID":"fa167200-33d2-4b18-adc4-1d5cb0051754","Type":"ContainerStarted","Data":"305ac5256f6de2c8d9f54e08f6b50a7635bc0dfd692dbe6b8c32a6185b56e201"} Jul 18 01:55:35.757130 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:35.757102 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9lmgp"] Jul 18 01:55:35.761679 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:55:35.761563 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc575c1_b702_446e_bea4_946ef1b61aef.slice/crio-fca83ef1187d1a880b0a51a3072de0855523f5ed53509b1784a50cb8a0e3581f WatchSource:0}: Error finding container fca83ef1187d1a880b0a51a3072de0855523f5ed53509b1784a50cb8a0e3581f: Status 404 returned error can't find the container with id fca83ef1187d1a880b0a51a3072de0855523f5ed53509b1784a50cb8a0e3581f Jul 18 01:55:35.906440 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:35.906354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:36.004247 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.004213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:36.105794 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.105752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:36.184687 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.184412 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:36.705849 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.705765 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9lmgp" event={"ID":"6dc575c1-b702-446e-bea4-946ef1b61aef","Type":"ContainerStarted","Data":"fca83ef1187d1a880b0a51a3072de0855523f5ed53509b1784a50cb8a0e3581f"} Jul 18 01:55:36.708377 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.708346 2558 generic.go:356] "Generic (PLEG): container finished" podID="6c9725a2-7e1e-40fd-9e98-1403c7fb978e" containerID="e014dc7f3aebfa0a473f0202592f9721bb1addeb5229f9e5e8b1081b07856bd7" exitCode=0 Jul 18 01:55:36.708511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.708482 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctq8k" event={"ID":"6c9725a2-7e1e-40fd-9e98-1403c7fb978e","Type":"ContainerDied","Data":"e014dc7f3aebfa0a473f0202592f9721bb1addeb5229f9e5e8b1081b07856bd7"} Jul 18 01:55:36.712103 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.712077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-gfh7b" event={"ID":"db2267fc-474a-403e-a122-da141b49a50d","Type":"ContainerStarted","Data":"054cff086a78c6450f5488c804e04c21ab54db26011d12cc8ad3ab6245611802"} Jul 18 01:55:36.712360 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.712304 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:36.729782 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.729747 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-gfh7b" Jul 18 01:55:36.744767 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:36.744709 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-gfh7b" podStartSLOduration=1.638572897 podStartE2EDuration="17.744676526s" totalImagesPullingTime="16.106103629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:36.744189888 +0000 UTC m=+293.530541954" watchObservedRunningTime="2026-07-18 01:55:36.744676526 +0000 UTC m=+293.531028593" Jul 18 01:55:37.718890 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:37.718845 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctq8k" event={"ID":"6c9725a2-7e1e-40fd-9e98-1403c7fb978e","Type":"ContainerStarted","Data":"beee0ae2c5883dd8ee2067c8fa2814cd4bc2405f2fbdb0c28ef682c27767f76f"} Jul 18 01:55:37.719405 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:37.719114 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctq8k" event={"ID":"6c9725a2-7e1e-40fd-9e98-1403c7fb978e","Type":"ContainerStarted","Data":"a758ce58b50aa99e58897086ff4494c17c64df5052c26fc21dd1733957ad4870"} Jul 18 01:55:37.722382 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:37.721945 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" event={"ID":"fa167200-33d2-4b18-adc4-1d5cb0051754","Type":"ContainerStarted","Data":"7bff2a3f528254b3bcc4a067d6de1e1bff46dab3f07e449f4fd9bad5acd2adcf"} Jul 18 01:55:37.731214 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:55:37.731178 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-szhpx" podUID="69126e0f-b661-4bcd-82ac-e2bd449a7d14" Jul 18 01:55:37.741448 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:37.741193 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ctq8k" podStartSLOduration=1.832314864 podStartE2EDuration="9.741171215s" totalImagesPullingTime="7.810296052s" totalInitContainerRuntime="98.560299ms" isStatefulPod=true podCreationTimestamp="2026-07-18 01:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:37.738595177 +0000 UTC m=+294.524947243" watchObservedRunningTime="2026-07-18 01:55:37.741171215 +0000 UTC m=+294.527523282" Jul 18 01:55:37.757481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:37.757426 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mp7ff" podStartSLOduration=8.172889789 podStartE2EDuration="9.757407686s" totalImagesPullingTime="1.584517897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:37.756295794 +0000 UTC m=+294.542647866" watchObservedRunningTime="2026-07-18 01:55:37.757407686 +0000 UTC m=+294.543759753" Jul 18 01:55:38.728067 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:38.728033 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9lmgp" event={"ID":"6dc575c1-b702-446e-bea4-946ef1b61aef","Type":"ContainerStarted","Data":"00fca9dd8fed0f9807c2cb8c8c847c9773e9a1eb4cf2dcc17e3dadc1fe59c860"} Jul 18 01:55:38.728553 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:38.728104 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9lmgp" Jul 18 01:55:38.728553 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:38.728126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9lmgp" event={"ID":"6dc575c1-b702-446e-bea4-946ef1b61aef","Type":"ContainerStarted","Data":"d2fa4f34cc8a0106f2db0dc4d84f838d9eeec851296052547b000ef067005ef3"} Jul 18 01:55:38.744329 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:38.744280 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9lmgp" podStartSLOduration=257.256799947 podStartE2EDuration="4m19.744263229s" totalImagesPullingTime="2.487463282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:38.743317438 +0000 UTC m=+295.529669588" watchObservedRunningTime="2026-07-18 01:55:38.744263229 +0000 UTC m=+295.530615294" Jul 18 01:55:39.219696 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:39.219658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:41.353440 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:41.353403 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:41.453227 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:41.453189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:41.837268 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:41.837203 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:41.937702 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:41.937661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:42.163223 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:42.163139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:42.237324 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:42.237281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:42.533699 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:42.533657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:42.634866 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:42.634810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:42.697736 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:42.697691 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:43.607097 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:43.607071 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 01:55:48.734615 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:48.734588 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9lmgp" Jul 18 01:55:50.390152 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:50.390114 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:50.490287 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:50.490261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:50.590862 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:50.590827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:50.645785 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:50.645703 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:50.729150 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:50.729118 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:55:52.900680 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:52.900649 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:58.571371 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:58.571337 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:58.670974 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:58.670937 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:59.655580 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:59.655528 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:55:59.751511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:55:59.751479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:01.899614 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:01.899577 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:01.958422 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:01.958386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:07.710608 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:07.710571 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" podUID="53100a1c-5930-4756-a577-6a466d8a65bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 18 01:56:13.570877 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:13.570838 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:13.668604 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:13.668569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:17.711170 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:17.711132 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" podUID="53100a1c-5930-4756-a577-6a466d8a65bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 18 01:56:27.710514 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.710476 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" podUID="53100a1c-5930-4756-a577-6a466d8a65bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 18 01:56:27.710878 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.710555 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" Jul 18 01:56:27.711040 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.711011 2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"20633e52c9a28a293a4b8703942264a35022d8712abe40f3ad1900164250024a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 18 01:56:27.711085 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.711059 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" podUID="53100a1c-5930-4756-a577-6a466d8a65bd" containerName="service-proxy" containerID="cri-o://20633e52c9a28a293a4b8703942264a35022d8712abe40f3ad1900164250024a" gracePeriod=30 Jul 18 01:56:27.891893 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.891851 2558 generic.go:356] "Generic (PLEG): container finished" podID="53100a1c-5930-4756-a577-6a466d8a65bd" containerID="20633e52c9a28a293a4b8703942264a35022d8712abe40f3ad1900164250024a" exitCode=2 Jul 18 01:56:27.892067 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.891947 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" event={"ID":"53100a1c-5930-4756-a577-6a466d8a65bd","Type":"ContainerDied","Data":"20633e52c9a28a293a4b8703942264a35022d8712abe40f3ad1900164250024a"} Jul 18 01:56:27.892067 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:27.891997 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dcdf5d7ff-rxx2c" event={"ID":"53100a1c-5930-4756-a577-6a466d8a65bd","Type":"ContainerStarted","Data":"a083f5fcf8403ea02fa57c153ba01cacb12cea7c0a3a1ac457d32bc888cb8168"} Jul 18 01:56:44.128418 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:44.128342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:44.178649 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:44.178615 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:46.604501 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:46.604457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:46.660850 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:46.660813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:55.981251 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:55.981216 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:56.030820 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:56.030790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:57.602190 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.602132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:56:57.604559 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.604538 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69126e0f-b661-4bcd-82ac-e2bd449a7d14-metrics-certs\") pod \"network-metrics-daemon-szhpx\" (UID: \"69126e0f-b661-4bcd-82ac-e2bd449a7d14\") " pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:56:57.632685 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.632655 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbznb\"" Jul 18 01:56:57.640723 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.640703 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szhpx" Jul 18 01:56:57.768903 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.768820 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-szhpx"] Jul 18 01:56:57.771554 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:56:57.771524 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69126e0f_b661_4bcd_82ac_e2bd449a7d14.slice/crio-3fb84c0b370da489473dab77e2940955ab128b1ddf041746211d4d877328c8fe WatchSource:0}: Error finding container 3fb84c0b370da489473dab77e2940955ab128b1ddf041746211d4d877328c8fe: Status 404 returned error can't find the container with id 3fb84c0b370da489473dab77e2940955ab128b1ddf041746211d4d877328c8fe Jul 18 01:56:57.773565 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.773545 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:56:57.989834 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:57.989803 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szhpx" event={"ID":"69126e0f-b661-4bcd-82ac-e2bd449a7d14","Type":"ContainerStarted","Data":"3fb84c0b370da489473dab77e2940955ab128b1ddf041746211d4d877328c8fe"} Jul 18 01:56:58.563986 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:58.563947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:58.664485 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:58.664450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:58.765803 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:58.765764 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:58.995273 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:58.995237 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szhpx" event={"ID":"69126e0f-b661-4bcd-82ac-e2bd449a7d14","Type":"ContainerStarted","Data":"934658d35e23cef62234bfd798978a7b486b75c24ed680be012df3c7c0c9859a"} Jul 18 01:56:58.995481 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:58.995303 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szhpx" event={"ID":"69126e0f-b661-4bcd-82ac-e2bd449a7d14","Type":"ContainerStarted","Data":"5bd283a0c6d82723d0521af6fda1c1e8e789cdd84ee37a8a6137a2d2e02d6500"} Jul 18 01:56:59.010311 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:59.010253 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-szhpx" podStartSLOduration=374.167445324 podStartE2EDuration="6m15.010233642s" totalImagesPullingTime="842.788318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:56:59.010083685 +0000 UTC m=+375.796435763" watchObservedRunningTime="2026-07-18 01:56:59.010233642 +0000 UTC m=+375.796585710" Jul 18 01:56:59.100270 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:59.100236 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:56:59.152625 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:56:59.152595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:01.170398 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:01.170366 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:01.228777 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:01.228749 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:03.393021 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:03.392984 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:03.446746 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:03.446709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:03.534378 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:03.534336 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:04.131515 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:04.131480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:04.182385 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:04.182353 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:13.659679 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:13.659639 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:13.743293 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:13.743257 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:13.843727 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:13.843691 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:13.944643 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:13.944561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:14.007346 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:14.007319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:45.039768 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:45.039731 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:54.805198 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:54.805160 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:57:54.898880 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:57:54.898838 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:16.284399 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:16.284363 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:17.660788 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:17.660753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:18.256850 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.256784 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx"] Jul 18 01:58:18.258980 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.258954 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.261556 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.261535 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 18 01:58:18.262398 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.262377 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 18 01:58:18.263625 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.263609 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-n64d9\"" Jul 18 01:58:18.277133 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.277109 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx"] Jul 18 01:58:18.353870 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.353832 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgnpp\" (UniqueName: \"kubernetes.io/projected/f4a217ba-95b5-40a4-ba39-a990a921b8f9-kube-api-access-mgnpp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vpvjx\" (UID: \"f4a217ba-95b5-40a4-ba39-a990a921b8f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.354057 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.353890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4a217ba-95b5-40a4-ba39-a990a921b8f9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vpvjx\" (UID: \"f4a217ba-95b5-40a4-ba39-a990a921b8f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.455179 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.455140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgnpp\" (UniqueName: \"kubernetes.io/projected/f4a217ba-95b5-40a4-ba39-a990a921b8f9-kube-api-access-mgnpp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vpvjx\" (UID: \"f4a217ba-95b5-40a4-ba39-a990a921b8f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.455378 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.455194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4a217ba-95b5-40a4-ba39-a990a921b8f9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vpvjx\" (UID: \"f4a217ba-95b5-40a4-ba39-a990a921b8f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.455525 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.455511 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4a217ba-95b5-40a4-ba39-a990a921b8f9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vpvjx\" (UID: \"f4a217ba-95b5-40a4-ba39-a990a921b8f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.464352 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.464326 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgnpp\" (UniqueName: \"kubernetes.io/projected/f4a217ba-95b5-40a4-ba39-a990a921b8f9-kube-api-access-mgnpp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vpvjx\" (UID: \"f4a217ba-95b5-40a4-ba39-a990a921b8f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.568698 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.568597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" Jul 18 01:58:18.704684 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:18.704649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx"] Jul 18 01:58:18.708262 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:58:18.708230 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a217ba_95b5_40a4_ba39_a990a921b8f9.slice/crio-6328795bd72512dd46afe3ce72c8ceb7141b6989bc4d96516f3b00a70530e926 WatchSource:0}: Error finding container 6328795bd72512dd46afe3ce72c8ceb7141b6989bc4d96516f3b00a70530e926: Status 404 returned error can't find the container with id 6328795bd72512dd46afe3ce72c8ceb7141b6989bc4d96516f3b00a70530e926 Jul 18 01:58:19.268018 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:19.267941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" event={"ID":"f4a217ba-95b5-40a4-ba39-a990a921b8f9","Type":"ContainerStarted","Data":"6328795bd72512dd46afe3ce72c8ceb7141b6989bc4d96516f3b00a70530e926"} Jul 18 01:58:19.898993 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:19.898956 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:19.999651 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:19.999602 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:21.277556 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:21.277523 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" event={"ID":"f4a217ba-95b5-40a4-ba39-a990a921b8f9","Type":"ContainerStarted","Data":"970d21b6cac1c2d8b478d8c9141773e91a05710220e82b464ec70c7ffcd7877f"} Jul 18 01:58:21.298507 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:21.298455 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vpvjx" podStartSLOduration=1.103763358 podStartE2EDuration="3.298437054s" totalImagesPullingTime="2.194673696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:21.297773551 +0000 UTC m=+458.084125630" watchObservedRunningTime="2026-07-18 01:58:21.298437054 +0000 UTC m=+458.084789120" Jul 18 01:58:21.594802 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:21.594711 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:21.720029 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:21.719993 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:21.830878 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:21.830845 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:21.945897 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:21.945806 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:22.720379 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.720338 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw"] Jul 18 01:58:22.722530 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.722506 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.725193 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.725171 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 01:58:22.725281 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.725171 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6rdrv\"" Jul 18 01:58:22.726243 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.726227 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 01:58:22.732015 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.731993 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw"] Jul 18 01:58:22.889795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.889757 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.890001 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.889813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.890001 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.889839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn2sm\" (UniqueName: \"kubernetes.io/projected/066fef31-e01b-4256-a26a-e4d7dd207f69-kube-api-access-vn2sm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.991332 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.991233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.991332 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.991276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn2sm\" (UniqueName: \"kubernetes.io/projected/066fef31-e01b-4256-a26a-e4d7dd207f69-kube-api-access-vn2sm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.991543 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.991336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.991720 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.991703 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.991761 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.991702 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:22.999186 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:22.999160 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn2sm\" (UniqueName: \"kubernetes.io/projected/066fef31-e01b-4256-a26a-e4d7dd207f69-kube-api-access-vn2sm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:23.032277 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:23.032244 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:23.157196 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:23.157164 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw"] Jul 18 01:58:23.159985 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:58:23.159961 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066fef31_e01b_4256_a26a_e4d7dd207f69.slice/crio-a0b8193896c26e9cbea75f074e1d6356140c23d7593ef0edaa44bc07a755dced WatchSource:0}: Error finding container a0b8193896c26e9cbea75f074e1d6356140c23d7593ef0edaa44bc07a755dced: Status 404 returned error can't find the container with id a0b8193896c26e9cbea75f074e1d6356140c23d7593ef0edaa44bc07a755dced Jul 18 01:58:23.285593 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:23.285502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" event={"ID":"066fef31-e01b-4256-a26a-e4d7dd207f69","Type":"ContainerStarted","Data":"a0b8193896c26e9cbea75f074e1d6356140c23d7593ef0edaa44bc07a755dced"} Jul 18 01:58:23.403630 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:23.403596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:23.988975 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:23.988936 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:26.883320 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:26.883277 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:26.938508 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:26.938465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:29.309368 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:29.309277 2558 generic.go:356] "Generic (PLEG): container finished" podID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerID="5ff1ce0aec8eccef815e6e43fad899ebecd55cf51d8cf1d8a915081d5446d7cf" exitCode=0 Jul 18 01:58:29.309721 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:29.309367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" event={"ID":"066fef31-e01b-4256-a26a-e4d7dd207f69","Type":"ContainerDied","Data":"5ff1ce0aec8eccef815e6e43fad899ebecd55cf51d8cf1d8a915081d5446d7cf"} Jul 18 01:58:30.368637 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.368605 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8skkj"] Jul 18 01:58:30.371923 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.371890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.374559 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.374535 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 01:58:30.374705 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.374537 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-79vnm\"" Jul 18 01:58:30.375589 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.375569 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 01:58:30.378240 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.378218 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8skkj"] Jul 18 01:58:30.452175 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.452141 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2xst\" (UniqueName: \"kubernetes.io/projected/08563192-7c25-4323-8b9d-75380ebecdad-kube-api-access-n2xst\") pod \"cert-manager-cainjector-559cdd8c87-8skkj\" (UID: \"08563192-7c25-4323-8b9d-75380ebecdad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.452332 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.452201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08563192-7c25-4323-8b9d-75380ebecdad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8skkj\" (UID: \"08563192-7c25-4323-8b9d-75380ebecdad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.552795 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.552762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2xst\" (UniqueName: \"kubernetes.io/projected/08563192-7c25-4323-8b9d-75380ebecdad-kube-api-access-n2xst\") pod \"cert-manager-cainjector-559cdd8c87-8skkj\" (UID: \"08563192-7c25-4323-8b9d-75380ebecdad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.552988 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.552839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08563192-7c25-4323-8b9d-75380ebecdad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8skkj\" (UID: \"08563192-7c25-4323-8b9d-75380ebecdad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.560793 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.560766 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08563192-7c25-4323-8b9d-75380ebecdad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8skkj\" (UID: \"08563192-7c25-4323-8b9d-75380ebecdad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.561039 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.560991 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2xst\" (UniqueName: \"kubernetes.io/projected/08563192-7c25-4323-8b9d-75380ebecdad-kube-api-access-n2xst\") pod \"cert-manager-cainjector-559cdd8c87-8skkj\" (UID: \"08563192-7c25-4323-8b9d-75380ebecdad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:30.684076 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:30.683994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" Jul 18 01:58:31.251605 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:31.251580 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8skkj"] Jul 18 01:58:31.254524 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:58:31.254501 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08563192_7c25_4323_8b9d_75380ebecdad.slice/crio-675c3a1abe026bf020ca784db6c3a03f58a7caeedaef03fa83f3c0e9a42be084 WatchSource:0}: Error finding container 675c3a1abe026bf020ca784db6c3a03f58a7caeedaef03fa83f3c0e9a42be084: Status 404 returned error can't find the container with id 675c3a1abe026bf020ca784db6c3a03f58a7caeedaef03fa83f3c0e9a42be084 Jul 18 01:58:31.319166 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:31.319131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" event={"ID":"066fef31-e01b-4256-a26a-e4d7dd207f69","Type":"ContainerStarted","Data":"b401fdf399a6217d56ec9af4dcc8f97cb882eae206295471877d6e39c603196a"} Jul 18 01:58:31.320414 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:31.320384 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" event={"ID":"08563192-7c25-4323-8b9d-75380ebecdad","Type":"ContainerStarted","Data":"675c3a1abe026bf020ca784db6c3a03f58a7caeedaef03fa83f3c0e9a42be084"} Jul 18 01:58:32.327729 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:32.327690 2558 generic.go:356] "Generic (PLEG): container finished" podID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerID="b401fdf399a6217d56ec9af4dcc8f97cb882eae206295471877d6e39c603196a" exitCode=0 Jul 18 01:58:32.328236 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:32.327756 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" event={"ID":"066fef31-e01b-4256-a26a-e4d7dd207f69","Type":"ContainerDied","Data":"b401fdf399a6217d56ec9af4dcc8f97cb882eae206295471877d6e39c603196a"} Jul 18 01:58:32.897932 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:32.897872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:34.339700 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:34.339611 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" event={"ID":"08563192-7c25-4323-8b9d-75380ebecdad","Type":"ContainerStarted","Data":"dae51d454465562e28a46624beba767c08d2954d23873bcaa26f1d0d17562d4d"} Jul 18 01:58:34.354106 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:34.354044 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8skkj" podStartSLOduration=1.5996382580000001 podStartE2EDuration="4.354028414s" totalImagesPullingTime="2.754390156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:34.353770553 +0000 UTC m=+471.140122635" watchObservedRunningTime="2026-07-18 01:58:34.354028414 +0000 UTC m=+471.140380480" Jul 18 01:58:34.894704 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:34.894666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:34.996580 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:34.996539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:39.361077 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:39.361046 2558 generic.go:356] "Generic (PLEG): container finished" podID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerID="a1631ccbb4db37073204da1a4711ea4963679a2f000cf1232cae07487986aadf" exitCode=0 Jul 18 01:58:39.361461 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:39.361115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" event={"ID":"066fef31-e01b-4256-a26a-e4d7dd207f69","Type":"ContainerDied","Data":"a1631ccbb4db37073204da1a4711ea4963679a2f000cf1232cae07487986aadf"} Jul 18 01:58:40.490071 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.490044 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:40.540951 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.540899 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-util\") pod \"066fef31-e01b-4256-a26a-e4d7dd207f69\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " Jul 18 01:58:40.541142 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.540982 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn2sm\" (UniqueName: \"kubernetes.io/projected/066fef31-e01b-4256-a26a-e4d7dd207f69-kube-api-access-vn2sm\") pod \"066fef31-e01b-4256-a26a-e4d7dd207f69\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " Jul 18 01:58:40.541142 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.541063 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-bundle\") pod \"066fef31-e01b-4256-a26a-e4d7dd207f69\" (UID: \"066fef31-e01b-4256-a26a-e4d7dd207f69\") " Jul 18 01:58:40.541431 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.541401 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-bundle" (OuterVolumeSpecName: "bundle") pod "066fef31-e01b-4256-a26a-e4d7dd207f69" (UID: "066fef31-e01b-4256-a26a-e4d7dd207f69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:58:40.543368 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.543342 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066fef31-e01b-4256-a26a-e4d7dd207f69-kube-api-access-vn2sm" (OuterVolumeSpecName: "kube-api-access-vn2sm") pod "066fef31-e01b-4256-a26a-e4d7dd207f69" (UID: "066fef31-e01b-4256-a26a-e4d7dd207f69"). InnerVolumeSpecName "kube-api-access-vn2sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:58:40.545965 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.545938 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-util" (OuterVolumeSpecName: "util") pod "066fef31-e01b-4256-a26a-e4d7dd207f69" (UID: "066fef31-e01b-4256-a26a-e4d7dd207f69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:58:40.642191 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.642092 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-util\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 01:58:40.642191 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.642134 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn2sm\" (UniqueName: \"kubernetes.io/projected/066fef31-e01b-4256-a26a-e4d7dd207f69-kube-api-access-vn2sm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 01:58:40.642191 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:40.642144 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/066fef31-e01b-4256-a26a-e4d7dd207f69-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 01:58:41.370420 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:41.370384 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" event={"ID":"066fef31-e01b-4256-a26a-e4d7dd207f69","Type":"ContainerDied","Data":"a0b8193896c26e9cbea75f074e1d6356140c23d7593ef0edaa44bc07a755dced"} Jul 18 01:58:41.370581 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:41.370430 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7bpxw" Jul 18 01:58:41.370581 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:41.370440 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0b8193896c26e9cbea75f074e1d6356140c23d7593ef0edaa44bc07a755dced" Jul 18 01:58:44.292867 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:44.292829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:44.391673 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:44.391642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:48.257880 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:48.257844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:48.312679 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:48.312647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:50.796521 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:50.796479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:50.897217 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:50.897174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:52.963207 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:52.963165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:58:53.047422 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047391 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29"] Jul 18 01:58:53.047642 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047630 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="extract" Jul 18 01:58:53.047642 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047643 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="extract" Jul 18 01:58:53.047722 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047652 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="pull" Jul 18 01:58:53.047722 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047657 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="pull" Jul 18 01:58:53.047722 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047669 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="util" Jul 18 01:58:53.047722 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047674 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="util" Jul 18 01:58:53.047722 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.047716 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="066fef31-e01b-4256-a26a-e4d7dd207f69" containerName="extract" Jul 18 01:58:53.108132 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.108093 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29"] Jul 18 01:58:53.108301 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.108219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.110891 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.110866 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6rdrv\"" Jul 18 01:58:53.111033 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.110867 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 01:58:53.111033 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.110870 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 01:58:53.238835 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.238743 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.238835 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.238783 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.238835 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.238817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwpbf\" (UniqueName: \"kubernetes.io/projected/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-kube-api-access-dwpbf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.340124 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.340094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.340124 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.340127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.340357 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.340156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwpbf\" (UniqueName: \"kubernetes.io/projected/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-kube-api-access-dwpbf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.340497 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.340475 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.340566 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.340526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.347574 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.347547 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwpbf\" (UniqueName: \"kubernetes.io/projected/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-kube-api-access-dwpbf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.417771 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.417738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:53.562801 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:53.562770 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29"] Jul 18 01:58:53.566339 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:58:53.566310 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e37eb4_7adf_47c6_a7d8_0181bb39274a.slice/crio-fd08c4c11d816a956e96f2658827f12195e7e177bb66178cda9efa27fb5ac77a WatchSource:0}: Error finding container fd08c4c11d816a956e96f2658827f12195e7e177bb66178cda9efa27fb5ac77a: Status 404 returned error can't find the container with id fd08c4c11d816a956e96f2658827f12195e7e177bb66178cda9efa27fb5ac77a Jul 18 01:58:54.417217 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:54.417183 2558 generic.go:356] "Generic (PLEG): container finished" podID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerID="cf4c4264bf2d0077be1deaaa51976395653b8e36e324e9183470bb46bd186bda" exitCode=0 Jul 18 01:58:54.417685 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:54.417238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" event={"ID":"c1e37eb4-7adf-47c6-a7d8-0181bb39274a","Type":"ContainerDied","Data":"cf4c4264bf2d0077be1deaaa51976395653b8e36e324e9183470bb46bd186bda"} Jul 18 01:58:54.417685 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:54.417273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" event={"ID":"c1e37eb4-7adf-47c6-a7d8-0181bb39274a","Type":"ContainerStarted","Data":"fd08c4c11d816a956e96f2658827f12195e7e177bb66178cda9efa27fb5ac77a"} Jul 18 01:58:55.423213 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:55.423124 2558 generic.go:356] "Generic (PLEG): container finished" podID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerID="6a8fb81bf2cddc026048a4564a92945610328ab093a979d805840e4035fbb5bc" exitCode=0 Jul 18 01:58:55.423213 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:55.423191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" event={"ID":"c1e37eb4-7adf-47c6-a7d8-0181bb39274a","Type":"ContainerDied","Data":"6a8fb81bf2cddc026048a4564a92945610328ab093a979d805840e4035fbb5bc"} Jul 18 01:58:56.429854 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:56.429818 2558 generic.go:356] "Generic (PLEG): container finished" podID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerID="0c773b25dd2f12707af72f3aef185942d6230bfcf34de6cef33535b6b244b8ca" exitCode=0 Jul 18 01:58:56.430320 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:56.429886 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" event={"ID":"c1e37eb4-7adf-47c6-a7d8-0181bb39274a","Type":"ContainerDied","Data":"0c773b25dd2f12707af72f3aef185942d6230bfcf34de6cef33535b6b244b8ca"} Jul 18 01:58:57.557443 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.557419 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:57.673841 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.673788 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwpbf\" (UniqueName: \"kubernetes.io/projected/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-kube-api-access-dwpbf\") pod \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " Jul 18 01:58:57.674071 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.673873 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-util\") pod \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " Jul 18 01:58:57.674071 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.673941 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-bundle\") pod \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\" (UID: \"c1e37eb4-7adf-47c6-a7d8-0181bb39274a\") " Jul 18 01:58:57.674683 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.674636 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-bundle" (OuterVolumeSpecName: "bundle") pod "c1e37eb4-7adf-47c6-a7d8-0181bb39274a" (UID: "c1e37eb4-7adf-47c6-a7d8-0181bb39274a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:58:57.676067 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.676041 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-kube-api-access-dwpbf" (OuterVolumeSpecName: "kube-api-access-dwpbf") pod "c1e37eb4-7adf-47c6-a7d8-0181bb39274a" (UID: "c1e37eb4-7adf-47c6-a7d8-0181bb39274a"). InnerVolumeSpecName "kube-api-access-dwpbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:58:57.679730 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.679696 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-util" (OuterVolumeSpecName: "util") pod "c1e37eb4-7adf-47c6-a7d8-0181bb39274a" (UID: "c1e37eb4-7adf-47c6-a7d8-0181bb39274a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:58:57.775013 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.774958 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwpbf\" (UniqueName: \"kubernetes.io/projected/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-kube-api-access-dwpbf\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 01:58:57.775013 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.775007 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-util\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 01:58:57.775013 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:57.775018 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e37eb4-7adf-47c6-a7d8-0181bb39274a-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 01:58:58.439284 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:58.439253 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" Jul 18 01:58:58.439489 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:58.439245 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6rj29" event={"ID":"c1e37eb4-7adf-47c6-a7d8-0181bb39274a","Type":"ContainerDied","Data":"fd08c4c11d816a956e96f2658827f12195e7e177bb66178cda9efa27fb5ac77a"} Jul 18 01:58:58.439489 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:58:58.439383 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd08c4c11d816a956e96f2658827f12195e7e177bb66178cda9efa27fb5ac77a" Jul 18 01:59:05.175688 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.175659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:05.250382 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250353 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64d778cd56-g666j"] Jul 18 01:59:05.250604 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250592 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="pull" Jul 18 01:59:05.250652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250605 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="pull" Jul 18 01:59:05.250652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250613 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="extract" Jul 18 01:59:05.250652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250619 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="extract" Jul 18 01:59:05.250652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250639 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="util" Jul 18 01:59:05.250652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250644 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="util" Jul 18 01:59:05.250791 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.250685 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e37eb4-7adf-47c6-a7d8-0181bb39274a" containerName="extract" Jul 18 01:59:05.252378 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.252363 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.255773 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.256189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.256939 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.257191 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.257387 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.257414 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 01:59:05.257934 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.257754 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sdk5z\"" Jul 18 01:59:05.263868 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.263844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64d778cd56-g666j"] Jul 18 01:59:05.331233 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.331203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5509cf56-1f5c-4f78-8f42-d3105c04174b-manager-config\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.331233 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.331237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knf8\" (UniqueName: \"kubernetes.io/projected/5509cf56-1f5c-4f78-8f42-d3105c04174b-kube-api-access-9knf8\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.331482 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.331276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5509cf56-1f5c-4f78-8f42-d3105c04174b-metrics-cert\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.331482 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.331358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5509cf56-1f5c-4f78-8f42-d3105c04174b-cert\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.417807 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.417769 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:05.432562 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.432484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5509cf56-1f5c-4f78-8f42-d3105c04174b-metrics-cert\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.432562 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.432521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5509cf56-1f5c-4f78-8f42-d3105c04174b-cert\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.432761 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.432712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5509cf56-1f5c-4f78-8f42-d3105c04174b-manager-config\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.432808 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.432774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knf8\" (UniqueName: \"kubernetes.io/projected/5509cf56-1f5c-4f78-8f42-d3105c04174b-kube-api-access-9knf8\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.433352 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.433329 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5509cf56-1f5c-4f78-8f42-d3105c04174b-manager-config\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.435164 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.435143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5509cf56-1f5c-4f78-8f42-d3105c04174b-metrics-cert\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.435261 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.435210 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5509cf56-1f5c-4f78-8f42-d3105c04174b-cert\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.440749 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.440724 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knf8\" (UniqueName: \"kubernetes.io/projected/5509cf56-1f5c-4f78-8f42-d3105c04174b-kube-api-access-9knf8\") pod \"lws-controller-manager-64d778cd56-g666j\" (UID: \"5509cf56-1f5c-4f78-8f42-d3105c04174b\") " pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.513101 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.513067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:05.563249 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.563219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:05.707445 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.707414 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64d778cd56-g666j"] Jul 18 01:59:05.710674 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:59:05.710645 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5509cf56_1f5c_4f78_8f42_d3105c04174b.slice/crio-162b4a98bc194a5f3d41376754de0910be37447b761beb75d0f68e2bf18270e1 WatchSource:0}: Error finding container 162b4a98bc194a5f3d41376754de0910be37447b761beb75d0f68e2bf18270e1: Status 404 returned error can't find the container with id 162b4a98bc194a5f3d41376754de0910be37447b761beb75d0f68e2bf18270e1 Jul 18 01:59:05.908733 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:05.908701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.113958 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.113831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.220147 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.220095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.278693 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.278660 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8"] Jul 18 01:59:06.280631 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.280615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.285817 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.285772 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 01:59:06.286001 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.285981 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 01:59:06.286284 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.286268 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 01:59:06.286960 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.286942 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9f4g4\"" Jul 18 01:59:06.287046 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.286998 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 01:59:06.302771 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.302745 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8"] Jul 18 01:59:06.400064 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.399973 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.442395 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.442310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27333d8c-0d3d-4799-8d21-53016498b315-tmp\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.442395 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.442392 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27333d8c-0d3d-4799-8d21-53016498b315-manifests\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.442661 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.442426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27333d8c-0d3d-4799-8d21-53016498b315-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.442661 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.442457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27333d8c-0d3d-4799-8d21-53016498b315-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.442661 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.442552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpvq\" (UniqueName: \"kubernetes.io/projected/27333d8c-0d3d-4799-8d21-53016498b315-kube-api-access-wjpvq\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.472128 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.472094 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" event={"ID":"5509cf56-1f5c-4f78-8f42-d3105c04174b","Type":"ContainerStarted","Data":"162b4a98bc194a5f3d41376754de0910be37447b761beb75d0f68e2bf18270e1"} Jul 18 01:59:06.494374 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.494342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.543585 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.543555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27333d8c-0d3d-4799-8d21-53016498b315-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.543744 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.543613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpvq\" (UniqueName: \"kubernetes.io/projected/27333d8c-0d3d-4799-8d21-53016498b315-kube-api-access-wjpvq\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.543744 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.543651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27333d8c-0d3d-4799-8d21-53016498b315-tmp\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.543744 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.543700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27333d8c-0d3d-4799-8d21-53016498b315-manifests\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.543744 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.543724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27333d8c-0d3d-4799-8d21-53016498b315-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.544235 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.544199 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27333d8c-0d3d-4799-8d21-53016498b315-manifests\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.546464 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.546438 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27333d8c-0d3d-4799-8d21-53016498b315-tmp\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.546858 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.546831 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27333d8c-0d3d-4799-8d21-53016498b315-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.546981 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.546870 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27333d8c-0d3d-4799-8d21-53016498b315-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.558552 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.558522 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpvq\" (UniqueName: \"kubernetes.io/projected/27333d8c-0d3d-4799-8d21-53016498b315-kube-api-access-wjpvq\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-5cpp8\" (UID: \"27333d8c-0d3d-4799-8d21-53016498b315\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.592471 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.592439 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:06.605069 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.604999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.696081 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.695999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.752367 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.752336 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.854685 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.854654 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.952741 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.952656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:06.964330 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:06.964305 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8"] Jul 18 01:59:06.966308 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:59:06.966280 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27333d8c_0d3d_4799_8d21_53016498b315.slice/crio-7b591bfe3bf861e5997b37030b6f522bfb3732ffd85014aaa7778c3b4bf93c84 WatchSource:0}: Error finding container 7b591bfe3bf861e5997b37030b6f522bfb3732ffd85014aaa7778c3b4bf93c84: Status 404 returned error can't find the container with id 7b591bfe3bf861e5997b37030b6f522bfb3732ffd85014aaa7778c3b4bf93c84 Jul 18 01:59:07.023695 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:07.023661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:07.479602 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:07.479364 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" event={"ID":"5509cf56-1f5c-4f78-8f42-d3105c04174b","Type":"ContainerStarted","Data":"7f054f31871c1f7e0265c71dd737117d3ab9a18eae1c76903870e99ffc3fa58e"} Jul 18 01:59:07.479602 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:07.479463 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:07.481057 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:07.481024 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" event={"ID":"27333d8c-0d3d-4799-8d21-53016498b315","Type":"ContainerStarted","Data":"7b591bfe3bf861e5997b37030b6f522bfb3732ffd85014aaa7778c3b4bf93c84"} Jul 18 01:59:07.501000 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:07.500943 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" podStartSLOduration=1.357401163 podStartE2EDuration="2.500921733s" totalImagesPullingTime="1.14352057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:07.499748007 +0000 UTC m=+504.286100099" watchObservedRunningTime="2026-07-18 01:59:07.500921733 +0000 UTC m=+504.287273793" Jul 18 01:59:10.500035 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:10.500003 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" event={"ID":"27333d8c-0d3d-4799-8d21-53016498b315","Type":"ContainerStarted","Data":"0441c95202d93eca921ee883b1dcb7f03f9cfc450c69632647b065dd869ffb87"} Jul 18 01:59:11.505701 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:11.505669 2558 generic.go:356] "Generic (PLEG): container finished" podID="27333d8c-0d3d-4799-8d21-53016498b315" containerID="0441c95202d93eca921ee883b1dcb7f03f9cfc450c69632647b065dd869ffb87" exitCode=0 Jul 18 01:59:11.506095 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:11.505740 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" event={"ID":"27333d8c-0d3d-4799-8d21-53016498b315","Type":"ContainerDied","Data":"0441c95202d93eca921ee883b1dcb7f03f9cfc450c69632647b065dd869ffb87"} Jul 18 01:59:11.674447 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:11.674405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:12.511642 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:12.511611 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" event={"ID":"27333d8c-0d3d-4799-8d21-53016498b315","Type":"ContainerStarted","Data":"1986fa2210580ea69314b044e4862e42d4aeb8baad803ff6695ba24ac856cf6e"} Jul 18 01:59:12.512060 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:12.511716 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:12.532055 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:12.532004 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" podStartSLOduration=2.462618026 podStartE2EDuration="6.53198933s" totalImagesPullingTime="2.984649062s" totalInitContainerRuntime="1.084722242s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:12.530412709 +0000 UTC m=+509.316764802" watchObservedRunningTime="2026-07-18 01:59:12.53198933 +0000 UTC m=+509.318341396" Jul 18 01:59:17.459265 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:17.459228 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:17.554959 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:17.554929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:18.487322 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:18.487291 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64d778cd56-g666j" Jul 18 01:59:23.517350 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:23.517318 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-5cpp8" Jul 18 01:59:25.014217 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:25.014184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:25.111307 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:25.111271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:25.763628 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:25.763597 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:25.919290 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:25.919250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:26.018413 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:26.018315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:26.119074 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:26.119038 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:26.218815 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:26.218785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:26.292453 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:26.292374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:26.935894 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:26.935861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:26.972053 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:26.972020 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw2t8"] Jul 18 01:59:27.056092 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.056050 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:27.085183 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.085149 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw2t8"] Jul 18 01:59:27.085339 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.085251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.087736 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.087711 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 18 01:59:27.198773 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.198685 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qn4\" (UniqueName: \"kubernetes.io/projected/2f3083fc-7f40-437c-bf92-dde79ac08249-kube-api-access-68qn4\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.198773 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.198741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3083fc-7f40-437c-bf92-dde79ac08249-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.299659 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.299623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qn4\" (UniqueName: \"kubernetes.io/projected/2f3083fc-7f40-437c-bf92-dde79ac08249-kube-api-access-68qn4\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.299832 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.299675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3083fc-7f40-437c-bf92-dde79ac08249-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.299832 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:59:27.299790 2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 18 01:59:27.299903 ip-10-0-143-37 kubenswrapper[2558]: E0718 01:59:27.299843 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3083fc-7f40-437c-bf92-dde79ac08249-tls-certs podName:2f3083fc-7f40-437c-bf92-dde79ac08249 nodeName:}" failed. No retries permitted until 2026-07-18 01:59:27.799826896 +0000 UTC m=+524.586178939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f3083fc-7f40-437c-bf92-dde79ac08249-tls-certs") pod "model-serving-api-54d89bd5fc-fw2t8" (UID: "2f3083fc-7f40-437c-bf92-dde79ac08249") : secret "model-serving-api-tls" not found Jul 18 01:59:27.308816 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.308787 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qn4\" (UniqueName: \"kubernetes.io/projected/2f3083fc-7f40-437c-bf92-dde79ac08249-kube-api-access-68qn4\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.480324 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.480288 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:27.805042 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.804954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3083fc-7f40-437c-bf92-dde79ac08249-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.807456 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.807439 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3083fc-7f40-437c-bf92-dde79ac08249-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2t8\" (UID: \"2f3083fc-7f40-437c-bf92-dde79ac08249\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:27.920511 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.920477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:27.995526 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:27.995483 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:28.124902 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:28.124865 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw2t8"] Jul 18 01:59:28.127468 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:59:28.127441 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3083fc_7f40_437c_bf92_dde79ac08249.slice/crio-fd302eaaa56712a2f60364b0d5dd8c65f6e986b3ff7b03f4c2f34462f98c064d WatchSource:0}: Error finding container fd302eaaa56712a2f60364b0d5dd8c65f6e986b3ff7b03f4c2f34462f98c064d: Status 404 returned error can't find the container with id fd302eaaa56712a2f60364b0d5dd8c65f6e986b3ff7b03f4c2f34462f98c064d Jul 18 01:59:28.578290 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:28.578253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" event={"ID":"2f3083fc-7f40-437c-bf92-dde79ac08249","Type":"ContainerStarted","Data":"fd302eaaa56712a2f60364b0d5dd8c65f6e986b3ff7b03f4c2f34462f98c064d"} Jul 18 01:59:29.584261 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:29.584228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" event={"ID":"2f3083fc-7f40-437c-bf92-dde79ac08249","Type":"ContainerStarted","Data":"30c3f08e07b257bcec10ae797e1493c34f8b6bc43e6a0a14822fa39c4305503d"} Jul 18 01:59:29.584671 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:29.584369 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:29.603727 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:29.603677 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" podStartSLOduration=2.219652851 podStartE2EDuration="3.603660699s" totalImagesPullingTime="1.384007848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:29.602702603 +0000 UTC m=+526.389054670" watchObservedRunningTime="2026-07-18 01:59:29.603660699 +0000 UTC m=+526.390012765" Jul 18 01:59:32.215925 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.215876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:32.315319 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.315286 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:32.770293 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.770260 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q"] Jul 18 01:59:32.772646 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.772629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.775327 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.775285 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 01:59:32.775480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.775337 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hspm7\"" Jul 18 01:59:32.775480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.775363 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 01:59:32.775480 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.775467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:59:32.790463 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.790420 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q"] Jul 18 01:59:32.808245 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.808212 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:32.943432 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943396 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45d9b577-58d9-499b-be02-f15aa5819768-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943432 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943484 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45d9b577-58d9-499b-be02-f15aa5819768-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8f88\" (UniqueName: \"kubernetes.io/projected/45d9b577-58d9-499b-be02-f15aa5819768-kube-api-access-k8f88\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943580 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:32.943652 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:32.943603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45d9b577-58d9-499b-be02-f15aa5819768-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.035394 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.035313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:33.044380 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45d9b577-58d9-499b-be02-f15aa5819768-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044542 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044542 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044659 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45d9b577-58d9-499b-be02-f15aa5819768-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044659 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044659 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044810 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8f88\" (UniqueName: \"kubernetes.io/projected/45d9b577-58d9-499b-be02-f15aa5819768-kube-api-access-k8f88\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044810 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044810 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044727 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.044810 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.044749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45d9b577-58d9-499b-be02-f15aa5819768-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.045102 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.045065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.045181 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.045156 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.045400 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.045375 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.045490 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.045443 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45d9b577-58d9-499b-be02-f15aa5819768-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.047158 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.047127 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45d9b577-58d9-499b-be02-f15aa5819768-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.047507 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.047487 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45d9b577-58d9-499b-be02-f15aa5819768-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.053748 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.053704 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45d9b577-58d9-499b-be02-f15aa5819768-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.054038 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.054017 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8f88\" (UniqueName: \"kubernetes.io/projected/45d9b577-58d9-499b-be02-f15aa5819768-kube-api-access-k8f88\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jw55q\" (UID: \"45d9b577-58d9-499b-be02-f15aa5819768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.082462 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.082425 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:33.220069 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.220037 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q"] Jul 18 01:59:33.223290 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:59:33.223258 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d9b577_58d9_499b_be02_f15aa5819768.slice/crio-9cef6d05a66a22b40faf4131891da58dde3e146b9012e9166b483bf1a159b8c0 WatchSource:0}: Error finding container 9cef6d05a66a22b40faf4131891da58dde3e146b9012e9166b483bf1a159b8c0: Status 404 returned error can't find the container with id 9cef6d05a66a22b40faf4131891da58dde3e146b9012e9166b483bf1a159b8c0 Jul 18 01:59:33.376487 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.376397 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:33.602491 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:33.602458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" event={"ID":"45d9b577-58d9-499b-be02-f15aa5819768","Type":"ContainerStarted","Data":"9cef6d05a66a22b40faf4131891da58dde3e146b9012e9166b483bf1a159b8c0"} Jul 18 01:59:34.741119 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.741083 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf"] Jul 18 01:59:34.744104 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.744081 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.746615 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.746584 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 18 01:59:34.746756 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.746636 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 18 01:59:34.746929 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.746887 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tk2hs\"" Jul 18 01:59:34.746995 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.746942 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 18 01:59:34.756291 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.756218 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf"] Jul 18 01:59:34.860158 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.860158 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.860375 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f15d3416-3aa4-4903-bd71-3c12b09008d7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.860375 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.860375 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.860524 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.860524 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.860437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slm5s\" (UniqueName: \"kubernetes.io/projected/f15d3416-3aa4-4903-bd71-3c12b09008d7-kube-api-access-slm5s\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.961778 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.961735 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f15d3416-3aa4-4903-bd71-3c12b09008d7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962039 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.961794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962039 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.961958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962039 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.962020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962222 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.962046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slm5s\" (UniqueName: \"kubernetes.io/projected/f15d3416-3aa4-4903-bd71-3c12b09008d7-kube-api-access-slm5s\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962222 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.962090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962222 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.962116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.962603 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.962563 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.965037 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.964992 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.965037 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.965024 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.965454 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.965432 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f15d3416-3aa4-4903-bd71-3c12b09008d7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.965631 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.965607 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.976279 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.976252 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f15d3416-3aa4-4903-bd71-3c12b09008d7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:34.976433 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:34.976290 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slm5s\" (UniqueName: \"kubernetes.io/projected/f15d3416-3aa4-4903-bd71-3c12b09008d7-kube-api-access-slm5s\") pod \"istiod-openshift-gateway-94bb8fbfd-z4vkf\" (UID: \"f15d3416-3aa4-4903-bd71-3c12b09008d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:35.056290 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:35.056191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:35.863118 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:35.863077 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 01:59:35.863423 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:35.863154 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 01:59:35.863423 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:35.863185 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 01:59:35.948558 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:35.948533 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf"] Jul 18 01:59:35.949369 ip-10-0-143-37 kubenswrapper[2558]: W0718 01:59:35.949332 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15d3416_3aa4_4903_bd71_3c12b09008d7.slice/crio-8b7c4527c9f6af3fbb4284c9aebdf748a4dc326e168e44768ab3e2c17e11c72f WatchSource:0}: Error finding container 8b7c4527c9f6af3fbb4284c9aebdf748a4dc326e168e44768ab3e2c17e11c72f: Status 404 returned error can't find the container with id 8b7c4527c9f6af3fbb4284c9aebdf748a4dc326e168e44768ab3e2c17e11c72f Jul 18 01:59:36.619187 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:36.619142 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" event={"ID":"f15d3416-3aa4-4903-bd71-3c12b09008d7","Type":"ContainerStarted","Data":"8b7c4527c9f6af3fbb4284c9aebdf748a4dc326e168e44768ab3e2c17e11c72f"} Jul 18 01:59:36.620669 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:36.620641 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" event={"ID":"45d9b577-58d9-499b-be02-f15aa5819768","Type":"ContainerStarted","Data":"702984ec50ba62adf6055073c217479144982ac6aa29a139245d6eb013411697"} Jul 18 01:59:36.645628 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:36.645572 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" podStartSLOduration=2.010838426 podStartE2EDuration="4.64555112s" totalImagesPullingTime="2.634712694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:36.64373435 +0000 UTC m=+533.430086417" watchObservedRunningTime="2026-07-18 01:59:36.64555112 +0000 UTC m=+533.431903189" Jul 18 01:59:36.851724 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:36.851689 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:36.982436 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:36.982398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:37.083364 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:37.083326 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:37.088869 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:37.088839 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:37.133380 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:37.133334 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:37.234291 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:37.234204 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:37.625614 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:37.625524 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:37.626859 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:37.626838 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jw55q" Jul 18 01:59:38.249500 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.249460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:38.344431 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.344392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:38.377235 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.377203 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 01:59:38.377310 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.377266 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 01:59:38.448692 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.448660 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:38.632377 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.632265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" event={"ID":"f15d3416-3aa4-4903-bd71-3c12b09008d7","Type":"ContainerStarted","Data":"64102fef0c7058283c986c162448f8ced3d68051a73045c6a34cc5e39fcd7d52"} Jul 18 01:59:38.671469 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:38.671414 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" podStartSLOduration=2.246028627 podStartE2EDuration="4.671396345s" totalImagesPullingTime="2.425367718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:38.670556331 +0000 UTC m=+535.456908397" watchObservedRunningTime="2026-07-18 01:59:38.671396345 +0000 UTC m=+535.457748411" Jul 18 01:59:39.267256 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:39.267222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 01:59:39.636862 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:39.636769 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:39.638568 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:39.638539 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-z4vkf" Jul 18 01:59:40.593317 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:40.593289 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fw2t8" Jul 18 01:59:55.883061 ip-10-0-143-37 kubenswrapper[2558]: I0718 01:59:55.883030 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:23.668198 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:23.668165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:25.032462 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:25.032427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:26.464586 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:26.464547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:26.531036 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:26.531002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:26.640780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:26.640741 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:27.396543 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:27.396511 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:27.591088 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:27.591056 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:48.898229 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:48.898120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:49.455836 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:49.455801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:50.301440 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:50.301406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:50.406413 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:50.406378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:51.073664 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:51.073619 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:51.989258 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:51.989224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:52.150998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:52.150965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:54.315146 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:54.315108 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:56.447985 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:56.447957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:57.310184 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:57.310148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:58.693560 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:58.693496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:59.867638 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:59.867602 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:00:59.974539 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:00:59.974505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:00.092873 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:00.092837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:00.260428 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:00.260392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:00.875119 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:00.875084 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:04.248487 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:04.248446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:04.298359 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:04.298328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:04.845155 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:04.845078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:04.910431 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:04.910391 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:06.982136 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:06.982097 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:07.166797 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:07.166765 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:08.652876 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:08.652844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:08.753249 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:08.753212 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:12.059659 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:12.059618 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:12.165943 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:12.165894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:16.050834 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:16.050794 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:16.114733 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:16.114706 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:20.356593 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:20.356544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:20.458125 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:20.458083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:24.846621 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:24.846585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:24.919166 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:24.919131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:25.052882 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:25.052846 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:25.154310 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:25.154213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:28.848138 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:28.848088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:28.948184 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:28.948151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:32.445830 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:32.445792 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:32.513855 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:32.513820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:36.557624 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:36.557582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:40.044063 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:40.043999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:40.144666 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:40.144634 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:57.743614 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.743582 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f"] Jul 18 02:01:57.746624 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.746603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.749066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.749045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mnf5k\"" Jul 18 02:01:57.757058 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.757036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f"] Jul 18 02:01:57.797367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.797334 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:57.819923 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.819885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820082 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.819942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820082 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.819979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820082 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.819995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820082 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.820014 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820082 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.820052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rzmf\" (UniqueName: \"kubernetes.io/projected/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-kube-api-access-9rzmf\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820263 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.820092 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820263 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.820134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.820263 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.820167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921247 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921247 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921494 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rzmf\" (UniqueName: \"kubernetes.io/projected/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-kube-api-access-9rzmf\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.921890 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921853 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.922042 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921904 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.922042 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.921975 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.922042 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.922028 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.922162 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.922039 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.923983 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.923956 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.924159 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.924144 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.929412 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.929392 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.929553 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.929536 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rzmf\" (UniqueName: \"kubernetes.io/projected/c6459608-0ce5-41ce-8eea-b12dcd9f1e53-kube-api-access-9rzmf\") pod \"maas-default-gateway-openshift-default-56654dcf7-8q85f\" (UID: \"c6459608-0ce5-41ce-8eea-b12dcd9f1e53\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:57.990316 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:57.990282 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:01:58.056511 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:58.056414 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:01:58.198602 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:58.198579 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f"] Jul 18 02:01:58.201023 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:01:58.200989 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6459608_0ce5_41ce_8eea_b12dcd9f1e53.slice/crio-850b6caacaa7859e19e10d986e53e5af5433ccf26fa51acfdd6dadb577686de2 WatchSource:0}: Error finding container 850b6caacaa7859e19e10d986e53e5af5433ccf26fa51acfdd6dadb577686de2: Status 404 returned error can't find the container with id 850b6caacaa7859e19e10d986e53e5af5433ccf26fa51acfdd6dadb577686de2 Jul 18 02:01:58.203207 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:58.203168 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:01:58.203321 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:58.203258 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:01:58.203321 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:58.203301 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:01:58.231180 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:58.231145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" event={"ID":"c6459608-0ce5-41ce-8eea-b12dcd9f1e53","Type":"ContainerStarted","Data":"850b6caacaa7859e19e10d986e53e5af5433ccf26fa51acfdd6dadb577686de2"} Jul 18 02:01:59.237445 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:59.237397 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" event={"ID":"c6459608-0ce5-41ce-8eea-b12dcd9f1e53","Type":"ContainerStarted","Data":"62605779dcb69131fb228f10c4fc5742e7085a665f2ca7522938498e752dab2c"} Jul 18 02:01:59.256525 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:01:59.256475 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" podStartSLOduration=2.256458556 podStartE2EDuration="2.256458556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:59.25486264 +0000 UTC m=+676.041214729" watchObservedRunningTime="2026-07-18 02:01:59.256458556 +0000 UTC m=+676.042810622" Jul 18 02:02:00.057127 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:00.057089 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:02:00.061780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:00.061757 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:02:00.242652 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:00.242622 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:02:00.243710 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:00.243694 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:02:11.683410 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:11.683367 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:11.780326 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:11.780281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:11.831023 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:11.830978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:12.488799 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:12.488747 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:12.552410 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:12.552378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:22.678770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:22.678727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:31.697328 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:31.697271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:31.802755 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:31.802717 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:32.156783 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:32.156743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:44.048757 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:44.048655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:44.444212 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:44.444121 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:51.467884 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:51.467844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:51.550640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:51.550605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:51.600506 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:51.600477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:51.741046 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:51.740942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:55.142028 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:55.141995 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:02:55.595209 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:02:55.595176 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:27.539426 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:27.539387 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:27.660554 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:27.660516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:28.058686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:28.058654 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:28.510610 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:28.510575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:28.613303 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:28.613263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:28.678023 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:28.677987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:36.662034 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:36.661997 2558 generic.go:356] "Generic (PLEG): container finished" podID="c6459608-0ce5-41ce-8eea-b12dcd9f1e53" containerID="62605779dcb69131fb228f10c4fc5742e7085a665f2ca7522938498e752dab2c" exitCode=0 Jul 18 02:03:36.662515 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:36.662068 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" event={"ID":"c6459608-0ce5-41ce-8eea-b12dcd9f1e53","Type":"ContainerDied","Data":"62605779dcb69131fb228f10c4fc5742e7085a665f2ca7522938498e752dab2c"} Jul 18 02:03:36.662515 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:36.662493 2558 scope.go:117] "RemoveContainer" containerID="62605779dcb69131fb228f10c4fc5742e7085a665f2ca7522938498e752dab2c" Jul 18 02:03:36.663845 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:36.663808 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:03:36.663999 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:36.663899 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:03:36.663999 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:36.663975 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:03:37.668284 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:37.668247 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" event={"ID":"c6459608-0ce5-41ce-8eea-b12dcd9f1e53","Type":"ContainerStarted","Data":"dfec1007d93f3b27a3fb8d7bbf3febc7cffcf8ee17278b715e066089a9fa3f38"} Jul 18 02:03:38.056739 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:38.056702 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:03:38.057029 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:38.057005 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8q85f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 18 02:03:38.057133 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:38.057065 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" podUID="c6459608-0ce5-41ce-8eea-b12dcd9f1e53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 18 02:03:39.057330 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:39.057277 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8q85f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 18 02:03:39.057716 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:39.057391 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" podUID="c6459608-0ce5-41ce-8eea-b12dcd9f1e53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 18 02:03:40.021162 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:40.021127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:40.057166 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:40.057132 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8q85f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 18 02:03:40.057333 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:40.057187 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" podUID="c6459608-0ce5-41ce-8eea-b12dcd9f1e53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 18 02:03:40.124930 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:40.124880 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:41.057189 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:41.057156 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8q85f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 18 02:03:41.057364 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:41.057244 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" podUID="c6459608-0ce5-41ce-8eea-b12dcd9f1e53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 18 02:03:42.061355 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:42.061324 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:03:42.061826 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:42.061720 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:03:42.062660 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:42.062638 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8q85f" Jul 18 02:03:45.978287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.978257 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55"] Jul 18 02:03:45.980553 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.980528 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:45.984165 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.984143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 18 02:03:45.984288 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.984213 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 02:03:45.984288 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.984216 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 02:03:45.984288 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.984219 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7rth8\"" Jul 18 02:03:45.990292 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:45.990265 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55"] Jul 18 02:03:46.004517 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.004485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:46.034675 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.034639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.034675 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.034678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.034845 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.034718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c388f18-b905-4355-a924-f2d565fc948f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.034845 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.034753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.034845 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.034779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.034845 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.034832 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqx7z\" (UniqueName: \"kubernetes.io/projected/0c388f18-b905-4355-a924-f2d565fc948f-kube-api-access-xqx7z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.135990 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.135954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136178 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.135999 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqx7z\" (UniqueName: \"kubernetes.io/projected/0c388f18-b905-4355-a924-f2d565fc948f-kube-api-access-xqx7z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136178 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136032 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136178 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136178 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c388f18-b905-4355-a924-f2d565fc948f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136178 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136476 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136451 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136603 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136556 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.136603 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.136573 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.138364 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.138340 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c388f18-b905-4355-a924-f2d565fc948f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.138786 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.138768 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c388f18-b905-4355-a924-f2d565fc948f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.143277 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.143252 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqx7z\" (UniqueName: \"kubernetes.io/projected/0c388f18-b905-4355-a924-f2d565fc948f-kube-api-access-xqx7z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55\" (UID: \"0c388f18-b905-4355-a924-f2d565fc948f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.291531 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.291430 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:46.426820 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.426724 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55"] Jul 18 02:03:46.429248 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:03:46.429219 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c388f18_b905_4355_a924_f2d565fc948f.slice/crio-7b1b4cd5821912d0db753f5db51b4eb585d8037988b45dcdf542b4b42ae18335 WatchSource:0}: Error finding container 7b1b4cd5821912d0db753f5db51b4eb585d8037988b45dcdf542b4b42ae18335: Status 404 returned error can't find the container with id 7b1b4cd5821912d0db753f5db51b4eb585d8037988b45dcdf542b4b42ae18335 Jul 18 02:03:46.430565 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.430547 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 02:03:46.715310 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:46.715273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" event={"ID":"0c388f18-b905-4355-a924-f2d565fc948f","Type":"ContainerStarted","Data":"7b1b4cd5821912d0db753f5db51b4eb585d8037988b45dcdf542b4b42ae18335"} Jul 18 02:03:47.721514 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:47.721478 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" event={"ID":"0c388f18-b905-4355-a924-f2d565fc948f","Type":"ContainerStarted","Data":"28b30309fd5239e0ddd3e6b932f80318e002d3684f5da881550de5fd525a5bff"} Jul 18 02:03:47.739143 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:47.739092 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" podStartSLOduration=1.747559718 podStartE2EDuration="2.73907483s" totalImagesPullingTime="991.515112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:03:47.737945365 +0000 UTC m=+784.524297432" watchObservedRunningTime="2026-07-18 02:03:47.73907483 +0000 UTC m=+784.525426895" Jul 18 02:03:50.008828 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:50.008790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:03:56.292143 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:56.292103 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:56.292563 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:56.292173 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:56.305141 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:56.305111 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:03:56.773688 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:03:56.773643 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55" Jul 18 02:04:01.617432 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:01.617399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:04:10.914520 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:10.914432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:04:17.474790 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.474757 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59"] Jul 18 02:04:17.480272 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.480251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.482787 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.482763 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 18 02:04:17.486074 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.486048 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59"] Jul 18 02:04:17.507498 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.507466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:04:17.608628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.608588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b36788fe-5547-432c-91a2-29e309b5f62a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.608628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.608627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.608873 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.608704 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.608873 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.608777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.608873 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.608863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.609035 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.608881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw59p\" (UniqueName: \"kubernetes.io/projected/b36788fe-5547-432c-91a2-29e309b5f62a-kube-api-access-hw59p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.709655 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.709610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.709655 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.709660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw59p\" (UniqueName: \"kubernetes.io/projected/b36788fe-5547-432c-91a2-29e309b5f62a-kube-api-access-hw59p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.709885 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.709699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b36788fe-5547-432c-91a2-29e309b5f62a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.709885 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.709722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.710047 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.709959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.710047 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.710022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.710160 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.710141 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.710211 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.710198 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.710382 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.710342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.712382 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.712358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b36788fe-5547-432c-91a2-29e309b5f62a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.712487 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.712470 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b36788fe-5547-432c-91a2-29e309b5f62a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.717128 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.717103 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw59p\" (UniqueName: \"kubernetes.io/projected/b36788fe-5547-432c-91a2-29e309b5f62a-kube-api-access-hw59p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nbw59\" (UID: \"b36788fe-5547-432c-91a2-29e309b5f62a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.791608 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.791498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:17.926255 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:17.926204 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59"] Jul 18 02:04:17.928561 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:04:17.928527 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36788fe_5547_432c_91a2_29e309b5f62a.slice/crio-eb3637aa6a652462fefd65e1963be5aa3bf5be582f44f14fc35c61dcbb74810b WatchSource:0}: Error finding container eb3637aa6a652462fefd65e1963be5aa3bf5be582f44f14fc35c61dcbb74810b: Status 404 returned error can't find the container with id eb3637aa6a652462fefd65e1963be5aa3bf5be582f44f14fc35c61dcbb74810b Jul 18 02:04:18.862146 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:18.862110 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" event={"ID":"b36788fe-5547-432c-91a2-29e309b5f62a","Type":"ContainerStarted","Data":"4f8ce540dc009e7a8299679cd9218757dfc82260fbf49ad9b6bc7e0e713dfd17"} Jul 18 02:04:18.862621 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:18.862171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" event={"ID":"b36788fe-5547-432c-91a2-29e309b5f62a","Type":"ContainerStarted","Data":"eb3637aa6a652462fefd65e1963be5aa3bf5be582f44f14fc35c61dcbb74810b"} Jul 18 02:04:18.878632 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:18.878576 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" podStartSLOduration=1.705259223 podStartE2EDuration="1.878558601s" totalImagesPullingTime="173.299378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:04:18.877718459 +0000 UTC m=+815.664070527" watchObservedRunningTime="2026-07-18 02:04:18.878558601 +0000 UTC m=+815.664910669" Jul 18 02:04:27.791830 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:27.791789 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:27.792259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:27.791856 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:27.804292 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:27.804263 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:27.910466 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:27.910436 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:04:27.913905 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:27.913882 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nbw59" Jul 18 02:04:50.558224 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:04:50.558178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:26.518595 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:26.518550 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:28.154267 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:28.154231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:39.018725 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:39.018637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:39.071297 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:39.071260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:46.721995 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:46.721951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:46.823654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:46.823623 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:47.902541 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:47.902502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:05:48.003260 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:05:48.003227 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:07:02.455548 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:07:02.455505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:07:02.553498 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:07:02.553460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:07:40.477918 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:07:40.477873 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:07:54.927210 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:07:54.927173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:07:56.150281 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:07:56.150243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:07:58.663755 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:07:58.663715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:31.761575 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:31.761522 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:31.862787 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:31.862752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:31.997422 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:31.997384 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:37.736534 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:37.736496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:37.900967 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:37.900921 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:37.996332 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:37.996243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:38.097484 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:38.097446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:43.748607 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:43.748571 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:08:43.848976 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:08:43.848940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:10:38.534462 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:10:38.534428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:10:40.030415 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:10:40.030381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:11:20.473312 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:11:20.473256 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:11:20.525853 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:11:20.525821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:13:25.234283 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:13:25.234247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:13:58.501399 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:13:58.501361 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:17:08.826222 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:17:08.826189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:19:45.484584 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:19:45.484552 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:19:52.938238 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:19:52.938204 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:01.189804 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:01.189768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:06.367545 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:06.367513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:09.458053 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:09.458018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:09.564060 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:09.564028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:09.862970 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:09.862865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:15.630757 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:15.630727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:15.706442 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:15.706392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:15.945722 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:15.945631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:16.182687 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.182659 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl"] Jul 18 02:20:16.185758 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.185739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.188313 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.188296 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c90146c5-openshift-default-dockercfg-gqdlc\"" Jul 18 02:20:16.201826 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.201774 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:16.211426 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.211398 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl"] Jul 18 02:20:16.262532 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-credential-socket\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.262532 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-podinfo\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.262795 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-socket\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.262795 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd9x4\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-kube-api-access-hd9x4\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.262795 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-envoy\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.262795 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-data\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.262795 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-token\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.263105 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-certs\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.263105 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.262886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istiod-ca-cert\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-credential-socket\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-podinfo\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-socket\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd9x4\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-kube-api-access-hd9x4\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-envoy\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-data\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363770 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-token\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-certs\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.363899 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.363840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istiod-ca-cert\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.364310 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.364094 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-credential-socket\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.364310 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.364232 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-data\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.364408 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.364381 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-socket\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.364466 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.364420 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-certs\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.365089 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.365067 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istiod-ca-cert\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.366342 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.366323 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-envoy\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.366686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.366670 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-podinfo\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.372219 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.372189 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd9x4\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-kube-api-access-hd9x4\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.372219 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.372205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-token\") pod \"e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.379987 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.379965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:16.496600 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.496566 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:16.634392 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.634340 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl"] Jul 18 02:20:16.636692 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:20:16.636660 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f021de5_1ef0_4827_a96f_1c1340f70b8f.slice/crio-679ab9b635bcab7064c653ddbef740aadcc812cbd3f8131a7985ea9e4d6729f1 WatchSource:0}: Error finding container 679ab9b635bcab7064c653ddbef740aadcc812cbd3f8131a7985ea9e4d6729f1: Status 404 returned error can't find the container with id 679ab9b635bcab7064c653ddbef740aadcc812cbd3f8131a7985ea9e4d6729f1 Jul 18 02:20:16.638851 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.638819 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:20:16.638965 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.638888 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:20:16.638965 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:16.638944 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:20:17.126681 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:17.126644 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" event={"ID":"0f021de5-1ef0-4827-a96f-1c1340f70b8f","Type":"ContainerStarted","Data":"58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e"} Jul 18 02:20:17.126863 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:17.126703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" event={"ID":"0f021de5-1ef0-4827-a96f-1c1340f70b8f","Type":"ContainerStarted","Data":"679ab9b635bcab7064c653ddbef740aadcc812cbd3f8131a7985ea9e4d6729f1"} Jul 18 02:20:17.151530 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:17.151470 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podStartSLOduration=1.151453528 podStartE2EDuration="1.151453528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:20:17.150213677 +0000 UTC m=+1773.936565757" watchObservedRunningTime="2026-07-18 02:20:17.151453528 +0000 UTC m=+1773.937805594" Jul 18 02:20:17.497417 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:17.497383 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:17.502332 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:17.502307 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:18.131042 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:18.131014 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:18.132198 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:18.132180 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:18.494824 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:18.494788 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:18.594490 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:18.594440 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:18.663487 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:18.663434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:18.763369 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:18.763293 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:19.143157 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:19.143071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:19.244123 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:19.244078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:34.173139 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:34.173093 2558 patch_prober.go:28] interesting pod/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 18 02:20:34.177717 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:34.173205 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 18 02:20:35.210998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:35.210894 2558 generic.go:356] "Generic (PLEG): container finished" podID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerID="58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e" exitCode=0 Jul 18 02:20:35.211396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:35.210979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" event={"ID":"0f021de5-1ef0-4827-a96f-1c1340f70b8f","Type":"ContainerDied","Data":"58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e"} Jul 18 02:20:35.211473 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:35.211456 2558 scope.go:117] "RemoveContainer" containerID="58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e" Jul 18 02:20:35.212667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:35.212635 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:20:35.212767 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:35.212708 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:20:35.212767 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:35.212749 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:20:36.217729 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:36.217689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" event={"ID":"0f021de5-1ef0-4827-a96f-1c1340f70b8f","Type":"ContainerStarted","Data":"68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a"} Jul 18 02:20:36.504199 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:36.504091 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:36.504488 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:36.504459 2558 patch_prober.go:28] interesting pod/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 18 02:20:36.504583 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:36.504518 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 18 02:20:37.497279 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:37.497228 2558 patch_prober.go:28] interesting pod/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 18 02:20:37.497797 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:37.497301 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 18 02:20:38.497086 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:38.497042 2558 patch_prober.go:28] interesting pod/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 18 02:20:38.497404 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:38.497372 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 18 02:20:39.497393 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:39.497350 2558 patch_prober.go:28] interesting pod/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 18 02:20:39.497929 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:39.497424 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 18 02:20:40.500729 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:40.500693 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:40.501209 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:40.501027 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:40.501777 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:40.501755 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:20:41.730058 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:41.730021 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:54.533881 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:54.533845 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:58.664349 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:58.664296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:58.731858 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:58.731807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:59.148390 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.148358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:59.293689 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.293655 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl"] Jul 18 02:20:59.293878 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.293856 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" containerID="cri-o://68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a" gracePeriod=30 Jul 18 02:20:59.317626 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.317591 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:59.552440 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.552413 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:59.812349 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.812261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:20:59.908351 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:20:59.908306 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:00.148614 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.148511 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:00.397081 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.397046 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh"] Jul 18 02:21:00.400155 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.400110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.404346 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.404316 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e5648ebb-gw-openshift-default-dockercfg-rftnv\"" Jul 18 02:21:00.416892 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.416856 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh"] Jul 18 02:21:00.445515 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.445480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:00.469383 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-socket\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469582 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-envoy\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469582 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469511 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-podinfo\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469710 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-data\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469710 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwk2z\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-kube-api-access-fwk2z\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469710 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-credential-socket\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-certs\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-token\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.469859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.469793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1908b14d-14e5-45db-a86a-5bf0ea798d39-istiod-ca-cert\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571100 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-data\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571100 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwk2z\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-kube-api-access-fwk2z\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571143 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-credential-socket\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-certs\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-token\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1908b14d-14e5-45db-a86a-5bf0ea798d39-istiod-ca-cert\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-socket\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-envoy\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571376 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-podinfo\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571717 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571523 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-credential-socket\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571717 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571547 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-data\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571717 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571631 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-certs\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.571866 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.571834 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-socket\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.572031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.572004 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1908b14d-14e5-45db-a86a-5bf0ea798d39-istiod-ca-cert\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.573926 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.573881 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-envoy\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.574045 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.573995 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-podinfo\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.579630 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.579594 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwk2z\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-kube-api-access-fwk2z\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.579740 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.579681 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-token\") pod \"e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.710936 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.710880 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:00.856303 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.856276 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh"] Jul 18 02:21:00.858668 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:21:00.858639 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1908b14d_14e5_45db_a86a_5bf0ea798d39.slice/crio-61cd6d00bb173516e9f6a21b89583687d564044f0f9b950139e8f8f930d47d83 WatchSource:0}: Error finding container 61cd6d00bb173516e9f6a21b89583687d564044f0f9b950139e8f8f930d47d83: Status 404 returned error can't find the container with id 61cd6d00bb173516e9f6a21b89583687d564044f0f9b950139e8f8f930d47d83 Jul 18 02:21:00.861317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.861279 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:00.861398 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.861357 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:00.861398 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.861384 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:00.878206 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:00.878183 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:01.339088 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:01.339046 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" event={"ID":"1908b14d-14e5-45db-a86a-5bf0ea798d39","Type":"ContainerStarted","Data":"3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f"} Jul 18 02:21:01.339263 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:01.339113 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" event={"ID":"1908b14d-14e5-45db-a86a-5bf0ea798d39","Type":"ContainerStarted","Data":"61cd6d00bb173516e9f6a21b89583687d564044f0f9b950139e8f8f930d47d83"} Jul 18 02:21:01.360938 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:01.360871 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podStartSLOduration=1.360855602 podStartE2EDuration="1.360855602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:21:01.358612681 +0000 UTC m=+1818.144964747" watchObservedRunningTime="2026-07-18 02:21:01.360855602 +0000 UTC m=+1818.147207667" Jul 18 02:21:01.711378 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:01.711340 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:01.716536 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:01.716511 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:02.343807 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:02.343772 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:02.344716 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:02.344698 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:02.826161 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:02.826125 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:02.948144 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:02.948117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:03.205021 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:03.204981 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:03.530271 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:03.530169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:03.639518 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:03.639484 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:04.543054 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.543032 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:21:04.610502 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610409 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-podinfo\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610502 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610469 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-data\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610507 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-certs\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610545 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-credential-socket\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610568 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd9x4\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-kube-api-access-hd9x4\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610609 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-token\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610632 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istiod-ca-cert\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.610721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610675 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-socket\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.611113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610735 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-envoy\") pod \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\" (UID: \"0f021de5-1ef0-4827-a96f-1c1340f70b8f\") " Jul 18 02:21:04.611113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.610853 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:04.611113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.611054 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.611276 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.611112 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:21:04.611276 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.611226 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:04.611276 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.611265 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:04.611615 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.611504 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:04.612948 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.612920 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:21:04.613081 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.613013 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:04.613369 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.613347 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-kube-api-access-hd9x4" (OuterVolumeSpecName: "kube-api-access-hd9x4") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "kube-api-access-hd9x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:21:04.613426 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.613371 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f021de5-1ef0-4827-a96f-1c1340f70b8f" (UID: "0f021de5-1ef0-4827-a96f-1c1340f70b8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:21:04.712259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712205 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712256 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712267 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712275 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd9x4\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-kube-api-access-hd9x4\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712542 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712286 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712542 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712294 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712542 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712302 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:04.712542 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:04.712309 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f021de5-1ef0-4827-a96f-1c1340f70b8f-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:05.358442 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.358406 2558 generic.go:356] "Generic (PLEG): container finished" podID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerID="68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a" exitCode=0 Jul 18 02:21:05.358612 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.358463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" event={"ID":"0f021de5-1ef0-4827-a96f-1c1340f70b8f","Type":"ContainerDied","Data":"68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a"} Jul 18 02:21:05.358612 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.358504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" event={"ID":"0f021de5-1ef0-4827-a96f-1c1340f70b8f","Type":"ContainerDied","Data":"679ab9b635bcab7064c653ddbef740aadcc812cbd3f8131a7985ea9e4d6729f1"} Jul 18 02:21:05.358612 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.358525 2558 scope.go:117] "RemoveContainer" containerID="68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a" Jul 18 02:21:05.358612 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.358463 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl" Jul 18 02:21:05.368445 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.368423 2558 scope.go:117] "RemoveContainer" containerID="58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e" Jul 18 02:21:05.376603 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.376583 2558 scope.go:117] "RemoveContainer" containerID="68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a" Jul 18 02:21:05.376857 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:21:05.376835 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a\": container with ID starting with 68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a not found: ID does not exist" containerID="68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a" Jul 18 02:21:05.376943 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.376868 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a"} err="failed to get container status \"68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a\": rpc error: code = NotFound desc = could not find container \"68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a\": container with ID starting with 68c80250d2800a30285be80ae10bd7cc9d9005f60e7c496036965ce31f7da13a not found: ID does not exist" Jul 18 02:21:05.376943 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.376886 2558 scope.go:117] "RemoveContainer" containerID="58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e" Jul 18 02:21:05.377132 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:21:05.377116 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e\": container with ID starting with 58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e not found: ID does not exist" containerID="58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e" Jul 18 02:21:05.377173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.377136 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e"} err="failed to get container status \"58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e\": rpc error: code = NotFound desc = could not find container \"58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e\": container with ID starting with 58078f4f034aae2a8b5f5260e03fbbaaa8f6644459c8cec3793c9560cb21dd9e not found: ID does not exist" Jul 18 02:21:05.381261 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.381237 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl"] Jul 18 02:21:05.384316 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.384291 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c90146c5-openshift-default-5bb8ccc677-vzhzl"] Jul 18 02:21:05.734771 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:05.734739 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" path="/var/lib/kubelet/pods/0f021de5-1ef0-4827-a96f-1c1340f70b8f/volumes" Jul 18 02:21:17.345697 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.345661 2558 patch_prober.go:28] interesting pod/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 18 02:21:17.346170 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.345720 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 18 02:21:17.420283 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.420254 2558 generic.go:356] "Generic (PLEG): container finished" podID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerID="3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f" exitCode=0 Jul 18 02:21:17.420450 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.420328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" event={"ID":"1908b14d-14e5-45db-a86a-5bf0ea798d39","Type":"ContainerDied","Data":"3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f"} Jul 18 02:21:17.420742 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.420727 2558 scope.go:117] "RemoveContainer" containerID="3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f" Jul 18 02:21:17.421817 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.421784 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:17.421941 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.421876 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:17.422012 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:17.421947 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:18.427120 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:18.427076 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" event={"ID":"1908b14d-14e5-45db-a86a-5bf0ea798d39","Type":"ContainerStarted","Data":"6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727"} Jul 18 02:21:18.712030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:18.711996 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:18.712455 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:18.712342 2558 patch_prober.go:28] interesting pod/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 18 02:21:18.712572 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:18.712471 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 18 02:21:19.712346 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:19.712306 2558 patch_prober.go:28] interesting pod/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 18 02:21:19.712992 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:19.712954 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 18 02:21:20.712183 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:20.712128 2558 patch_prober.go:28] interesting pod/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 18 02:21:20.712400 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:20.712208 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 18 02:21:21.711349 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:21.711307 2558 patch_prober.go:28] interesting pod/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 18 02:21:21.711640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:21.711612 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 18 02:21:22.715434 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:22.715398 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:22.715966 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:22.715798 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:22.716580 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:22.716563 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:38.627179 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:38.627129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:42.966342 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:42.966300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:43.160800 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.160765 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh"] Jul 18 02:21:43.161021 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.160992 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" containerID="cri-o://6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727" gracePeriod=30 Jul 18 02:21:43.220371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.220282 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:43.450639 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.450600 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:43.673358 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.673270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:43.985356 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.985322 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c"] Jul 18 02:21:43.985787 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.985767 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" Jul 18 02:21:43.985842 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.985793 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" Jul 18 02:21:43.985923 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.985893 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" Jul 18 02:21:43.985964 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.985932 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" Jul 18 02:21:43.990552 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.990533 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:43.994022 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:43.994001 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-602fb62c-openshift-default-dockercfg-6wb55\"" Jul 18 02:21:44.006287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.006264 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c"] Jul 18 02:21:44.050312 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.050279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:44.057623 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-certs\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.057766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-token\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.057766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-podinfo\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.057766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057703 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-credential-socket\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.057766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-envoy\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.057766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istiod-ca-cert\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.058040 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946hk\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-kube-api-access-946hk\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.058040 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-data\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.058040 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.057962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-socket\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158550 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946hk\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-kube-api-access-946hk\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-data\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158599 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-socket\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-certs\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-token\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-podinfo\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.158750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158726 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-credential-socket\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.159093 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-envoy\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.159093 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.158776 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istiod-ca-cert\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.159526 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.159363 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-socket\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.159526 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.159368 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-data\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.159726 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.159567 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-credential-socket\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.159829 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.159805 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-certs\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.162576 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.160182 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istiod-ca-cert\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.162576 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.162517 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-podinfo\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.165826 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.165799 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-envoy\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.171958 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.171934 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-token\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.172767 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.172749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-946hk\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-kube-api-access-946hk\") pod \"e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.299901 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.299818 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:44.337553 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.337506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:44.453810 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.453786 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c"] Jul 18 02:21:44.455571 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:21:44.455541 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6432ff_f439_4f51_bd0c_aff49c2c353f.slice/crio-f2f3a52d77fc961f63f5628afbd6b549cc0c170ab93de0664154f86e31342168 WatchSource:0}: Error finding container f2f3a52d77fc961f63f5628afbd6b549cc0c170ab93de0664154f86e31342168: Status 404 returned error can't find the container with id f2f3a52d77fc961f63f5628afbd6b549cc0c170ab93de0664154f86e31342168 Jul 18 02:21:44.457597 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.457562 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:44.457675 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.457649 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:44.457711 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.457676 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:21:44.543990 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.543952 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" event={"ID":"ab6432ff-f439-4f51-bd0c-aff49c2c353f","Type":"ContainerStarted","Data":"010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22"} Jul 18 02:21:44.544153 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.544023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" event={"ID":"ab6432ff-f439-4f51-bd0c-aff49c2c353f","Type":"ContainerStarted","Data":"f2f3a52d77fc961f63f5628afbd6b549cc0c170ab93de0664154f86e31342168"} Jul 18 02:21:44.574298 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:44.574190 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podStartSLOduration=1.5741755240000002 podStartE2EDuration="1.574175524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:21:44.571933318 +0000 UTC m=+1861.358285378" watchObservedRunningTime="2026-07-18 02:21:44.574175524 +0000 UTC m=+1861.360527590" Jul 18 02:21:45.300965 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:45.300882 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:45.305879 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:45.305851 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:45.549145 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:45.549107 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:45.550188 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:45.550162 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:21:46.086396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:46.086365 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:46.211143 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:46.211095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:46.299699 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:46.299663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:46.726221 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:46.726184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:47.051762 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:47.051683 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:47.177296 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:47.177266 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:21:48.403159 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.403123 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:48.496783 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496738 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-socket\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.496783 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496782 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-credential-socket\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496822 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-token\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496849 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-podinfo\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496882 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-envoy\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496950 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-data\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.496990 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-certs\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497024 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwk2z\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-kube-api-access-fwk2z\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497048 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1908b14d-14e5-45db-a86a-5bf0ea798d39-istiod-ca-cert\") pod \"1908b14d-14e5-45db-a86a-5bf0ea798d39\" (UID: \"1908b14d-14e5-45db-a86a-5bf0ea798d39\") " Jul 18 02:21:48.497418 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497095 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:48.497418 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497182 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:48.497418 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497309 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:48.497418 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497390 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.497418 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497409 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.497642 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.497466 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1908b14d-14e5-45db-a86a-5bf0ea798d39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:21:48.498094 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.498068 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-data" (OuterVolumeSpecName: "istio-data") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:48.499390 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.499363 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:21:48.499490 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.499396 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-kube-api-access-fwk2z" (OuterVolumeSpecName: "kube-api-access-fwk2z") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "kube-api-access-fwk2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:21:48.499592 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.499577 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:21:48.499676 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.499663 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-token" (OuterVolumeSpecName: "istio-token") pod "1908b14d-14e5-45db-a86a-5bf0ea798d39" (UID: "1908b14d-14e5-45db-a86a-5bf0ea798d39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:21:48.563496 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.563467 2558 generic.go:356] "Generic (PLEG): container finished" podID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerID="6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727" exitCode=0 Jul 18 02:21:48.563654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.563514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" event={"ID":"1908b14d-14e5-45db-a86a-5bf0ea798d39","Type":"ContainerDied","Data":"6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727"} Jul 18 02:21:48.563654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.563519 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" Jul 18 02:21:48.563654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.563558 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh" event={"ID":"1908b14d-14e5-45db-a86a-5bf0ea798d39","Type":"ContainerDied","Data":"61cd6d00bb173516e9f6a21b89583687d564044f0f9b950139e8f8f930d47d83"} Jul 18 02:21:48.563654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.563579 2558 scope.go:117] "RemoveContainer" containerID="6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727" Jul 18 02:21:48.572862 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.572846 2558 scope.go:117] "RemoveContainer" containerID="3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f" Jul 18 02:21:48.580682 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.580662 2558 scope.go:117] "RemoveContainer" containerID="6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727" Jul 18 02:21:48.580991 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:21:48.580929 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727\": container with ID starting with 6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727 not found: ID does not exist" containerID="6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727" Jul 18 02:21:48.580991 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.580959 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727"} err="failed to get container status \"6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727\": rpc error: code = NotFound desc = could not find container \"6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727\": container with ID starting with 6bdddf28371c40b31a62d9a38b8e5e3862be295689a7a99d1a9c6f37a7fad727 not found: ID does not exist" Jul 18 02:21:48.580991 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.580977 2558 scope.go:117] "RemoveContainer" containerID="3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f" Jul 18 02:21:48.581233 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:21:48.581214 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f\": container with ID starting with 3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f not found: ID does not exist" containerID="3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f" Jul 18 02:21:48.581275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.581240 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f"} err="failed to get container status \"3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f\": rpc error: code = NotFound desc = could not find container \"3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f\": container with ID starting with 3fe117ae322795c65ccf3f8ae605feda86d0305f5057476fb1e5738a85ca887f not found: ID does not exist" Jul 18 02:21:48.593871 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.593831 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh"] Jul 18 02:21:48.599297 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599266 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.599297 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599297 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.599452 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599309 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.599452 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599321 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1908b14d-14e5-45db-a86a-5bf0ea798d39-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.599452 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599335 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwk2z\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-kube-api-access-fwk2z\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.599452 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599349 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1908b14d-14e5-45db-a86a-5bf0ea798d39-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.599452 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.599361 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1908b14d-14e5-45db-a86a-5bf0ea798d39-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:21:48.601079 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:48.601058 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e5648ebb-gw-openshift-default-8949f4fc5-tk2fh"] Jul 18 02:21:49.734871 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:21:49.734834 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" path="/var/lib/kubelet/pods/1908b14d-14e5-45db-a86a-5bf0ea798d39/volumes" Jul 18 02:22:00.550794 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.550711 2558 patch_prober.go:28] interesting pod/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 02:22:00.550794 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.550765 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 02:22:00.625186 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.625095 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerID="010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22" exitCode=0 Jul 18 02:22:00.625186 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.625154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" event={"ID":"ab6432ff-f439-4f51-bd0c-aff49c2c353f","Type":"ContainerDied","Data":"010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22"} Jul 18 02:22:00.625527 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.625512 2558 scope.go:117] "RemoveContainer" containerID="010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22" Jul 18 02:22:00.626555 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.626523 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:00.626628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.626612 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:00.626672 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:00.626655 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:01.631427 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:01.631392 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" event={"ID":"ab6432ff-f439-4f51-bd0c-aff49c2c353f","Type":"ContainerStarted","Data":"9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7"} Jul 18 02:22:02.300358 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:02.300304 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:22:02.300630 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:02.300598 2558 patch_prober.go:28] interesting pod/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 02:22:02.300722 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:02.300667 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 02:22:03.301370 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:03.301318 2558 patch_prober.go:28] interesting pod/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 02:22:03.301929 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:03.301394 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 02:22:04.300958 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:04.300882 2558 patch_prober.go:28] interesting pod/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 02:22:04.301268 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:04.301236 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 02:22:05.301003 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:05.300426 2558 patch_prober.go:28] interesting pod/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 02:22:05.301003 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:05.300512 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 02:22:06.304709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:06.304674 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:22:06.305152 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:06.304951 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:22:06.305650 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:06.305633 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:22:22.780318 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:22.780281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:27.065948 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:27.065892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:28.376846 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:28.376806 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c"] Jul 18 02:22:28.377311 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:28.377053 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" containerID="cri-o://9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7" gracePeriod=30 Jul 18 02:22:28.442675 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:28.442625 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:28.634463 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:28.634358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:28.850519 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:28.850485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:29.241674 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.241638 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh"] Jul 18 02:22:29.241979 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.241966 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" Jul 18 02:22:29.242030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.241981 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f021de5-1ef0-4827-a96f-1c1340f70b8f" containerName="istio-proxy" Jul 18 02:22:29.242030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.241994 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" Jul 18 02:22:29.242030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.242000 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" Jul 18 02:22:29.242030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.242014 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" Jul 18 02:22:29.242030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.242019 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" Jul 18 02:22:29.242181 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.242082 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" Jul 18 02:22:29.245140 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.245123 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.248513 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.248493 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-218ab5db-openshift-default-dockercfg-k6jhv\"" Jul 18 02:22:29.261469 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-certs\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261469 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-podinfo\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261611 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261489 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-credential-socket\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261611 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261553 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-socket\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261611 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261585 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istiod-ca-cert\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-token\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-envoy\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261694 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8cls\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-kube-api-access-v8cls\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.261800 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.261724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-data\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.289767 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.289736 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh"] Jul 18 02:22:29.362431 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-socket\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istiod-ca-cert\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-token\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-envoy\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8cls\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-kube-api-access-v8cls\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-data\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362889 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-certs\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362889 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-podinfo\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362889 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-credential-socket\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.362889 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.362861 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-socket\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.363157 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.363021 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-data\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.363217 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.363163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-credential-socket\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.363278 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.363216 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-certs\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.363333 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.363312 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istiod-ca-cert\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.364992 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.364966 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-envoy\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.365398 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.365375 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-podinfo\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.376734 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.376705 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8cls\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-kube-api-access-v8cls\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.378226 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.378202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-token\") pod \"e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.379225 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.379203 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:29.557317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.557235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:29.629890 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.629860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:29.713005 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.712972 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh"] Jul 18 02:22:29.714252 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:22:29.714220 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6694a648_cfac_42ec_a7e0_f2f17daefe6f.slice/crio-ae92767e80e1f7696584a5bcf1d1b4a1f6f34b5e7ceaf89ac16e67af7e73f93c WatchSource:0}: Error finding container ae92767e80e1f7696584a5bcf1d1b4a1f6f34b5e7ceaf89ac16e67af7e73f93c: Status 404 returned error can't find the container with id ae92767e80e1f7696584a5bcf1d1b4a1f6f34b5e7ceaf89ac16e67af7e73f93c Jul 18 02:22:29.716201 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.716171 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:29.716261 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.716238 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:29.716293 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.716267 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:29.757089 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:29.757052 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" event={"ID":"6694a648-cfac-42ec-a7e0-f2f17daefe6f","Type":"ContainerStarted","Data":"ae92767e80e1f7696584a5bcf1d1b4a1f6f34b5e7ceaf89ac16e67af7e73f93c"} Jul 18 02:22:30.763297 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:30.763259 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" event={"ID":"6694a648-cfac-42ec-a7e0-f2f17daefe6f","Type":"ContainerStarted","Data":"72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367"} Jul 18 02:22:30.805087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:30.805032 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podStartSLOduration=1.8050164400000002 podStartE2EDuration="1.80501644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:22:30.80335196 +0000 UTC m=+1907.589704025" watchObservedRunningTime="2026-07-18 02:22:30.80501644 +0000 UTC m=+1907.591368506" Jul 18 02:22:31.557568 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:31.557528 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:31.563236 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:31.563176 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:31.767607 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:31.767569 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:31.768551 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:31.768533 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:32.353503 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:32.353466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:32.538996 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:32.538945 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:32.785488 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:32.785448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:33.046859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.046742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:33.628329 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.628304 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:22:33.701743 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701656 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-token\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701743 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701703 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-socket\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701743 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-data\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701826 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-podinfo\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701850 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-envoy\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701880 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istiod-ca-cert\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701936 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-certs\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.701972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701965 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-946hk\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-kube-api-access-946hk\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.702273 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.701992 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-credential-socket\") pod \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\" (UID: \"ab6432ff-f439-4f51-bd0c-aff49c2c353f\") " Jul 18 02:22:33.702273 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.702076 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:22:33.702273 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.702266 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:22:33.702424 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.702288 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.702503 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.702469 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:22:33.703056 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.702878 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:22:33.703287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.703255 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:22:33.704840 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.704815 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:22:33.704961 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.704848 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:22:33.704961 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.704944 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-kube-api-access-946hk" (OuterVolumeSpecName: "kube-api-access-946hk") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "kube-api-access-946hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:22:33.704961 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.704940 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab6432ff-f439-4f51-bd0c-aff49c2c353f" (UID: "ab6432ff-f439-4f51-bd0c-aff49c2c353f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:22:33.778508 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.778473 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerID="9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7" exitCode=0 Jul 18 02:22:33.778670 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.778539 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" Jul 18 02:22:33.778670 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.778550 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" event={"ID":"ab6432ff-f439-4f51-bd0c-aff49c2c353f","Type":"ContainerDied","Data":"9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7"} Jul 18 02:22:33.778670 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.778604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c" event={"ID":"ab6432ff-f439-4f51-bd0c-aff49c2c353f","Type":"ContainerDied","Data":"f2f3a52d77fc961f63f5628afbd6b549cc0c170ab93de0664154f86e31342168"} Jul 18 02:22:33.778670 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.778626 2558 scope.go:117] "RemoveContainer" containerID="9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7" Jul 18 02:22:33.787194 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.787175 2558 scope.go:117] "RemoveContainer" containerID="010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22" Jul 18 02:22:33.795066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.795048 2558 scope.go:117] "RemoveContainer" containerID="9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7" Jul 18 02:22:33.797966 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:22:33.795716 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7\": container with ID starting with 9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7 not found: ID does not exist" containerID="9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7" Jul 18 02:22:33.797966 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.795768 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7"} err="failed to get container status \"9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7\": rpc error: code = NotFound desc = could not find container \"9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7\": container with ID starting with 9b5609f8cb432af8fb501f4e438afef70f06c196f21819a62e40f78fa36f35e7 not found: ID does not exist" Jul 18 02:22:33.797966 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.795791 2558 scope.go:117] "RemoveContainer" containerID="010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22" Jul 18 02:22:33.797966 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:22:33.796170 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22\": container with ID starting with 010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22 not found: ID does not exist" containerID="010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22" Jul 18 02:22:33.797966 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.796199 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22"} err="failed to get container status \"010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22\": rpc error: code = NotFound desc = could not find container \"010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22\": container with ID starting with 010c3e33e7ea31b08e294a27cbddf6d22f46a55211d301d8c3cd3ee16a2afa22 not found: ID does not exist" Jul 18 02:22:33.803547 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803519 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803552 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803566 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803578 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803592 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-946hk\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-kube-api-access-946hk\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803605 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803618 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.803645 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.803630 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab6432ff-f439-4f51-bd0c-aff49c2c353f-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:22:33.831076 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.831043 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c"] Jul 18 02:22:33.842364 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.842337 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-602fb62c-openshift-default-5c899bb4df-mcn8c"] Jul 18 02:22:33.842542 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:33.842515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:34.044854 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:34.044818 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:22:35.734998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:35.734962 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" path="/var/lib/kubelet/pods/ab6432ff-f439-4f51-bd0c-aff49c2c353f/volumes" Jul 18 02:22:45.841453 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:45.841360 2558 generic.go:356] "Generic (PLEG): container finished" podID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerID="72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367" exitCode=0 Jul 18 02:22:45.841453 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:45.841436 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" event={"ID":"6694a648-cfac-42ec-a7e0-f2f17daefe6f","Type":"ContainerDied","Data":"72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367"} Jul 18 02:22:45.841895 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:45.841825 2558 scope.go:117] "RemoveContainer" containerID="72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367" Jul 18 02:22:45.842798 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:45.842770 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:45.842868 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:45.842851 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:45.842940 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:45.842898 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:22:46.767605 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:46.767567 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:46.848742 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:46.848708 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" event={"ID":"6694a648-cfac-42ec-a7e0-f2f17daefe6f","Type":"ContainerStarted","Data":"79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4"} Jul 18 02:22:47.557737 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:47.557697 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:47.558864 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:47.558837 2558 patch_prober.go:28] interesting pod/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 18 02:22:47.559019 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:47.558900 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 18 02:22:48.558536 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:48.558495 2558 patch_prober.go:28] interesting pod/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 18 02:22:48.558976 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:48.558555 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 18 02:22:49.557835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:49.557798 2558 patch_prober.go:28] interesting pod/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 18 02:22:49.558033 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:49.557865 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 18 02:22:50.557825 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:50.557784 2558 patch_prober.go:28] interesting pod/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 18 02:22:50.558250 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:50.557847 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 18 02:22:51.558657 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:51.558623 2558 patch_prober.go:28] interesting pod/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 18 02:22:51.559077 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:51.558679 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 18 02:22:52.561707 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:52.561668 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:52.562115 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:52.561954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:22:52.562725 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:22:52.562709 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:23:08.047284 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:08.047237 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:12.388140 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:12.388108 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:12.626531 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:12.626495 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh"] Jul 18 02:23:12.626702 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:12.626688 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" containerID="cri-o://79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4" gracePeriod=30 Jul 18 02:23:12.666013 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:12.665903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:12.868319 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:12.868290 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:13.346743 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:13.346712 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:13.438744 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:13.438716 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:13.578324 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:13.578291 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:15.090834 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:15.090768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:17.879144 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.879119 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:23:17.903536 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903460 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8cls\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-kube-api-access-v8cls\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903536 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903510 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-certs\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903585 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-token\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903614 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-socket\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903650 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-data\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903675 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-envoy\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903718 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-podinfo\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.903770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903753 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-credential-socket\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.904113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903775 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istiod-ca-cert\") pod \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\" (UID: \"6694a648-cfac-42ec-a7e0-f2f17daefe6f\") " Jul 18 02:23:17.904113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903880 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:23:17.904113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.903893 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:23:17.904259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.904115 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:23:17.904259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.904127 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:17.904259 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.904147 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:17.904886 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.904467 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:23:17.904886 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.904612 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:23:17.906123 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.906092 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:23:17.906261 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.906143 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-kube-api-access-v8cls" (OuterVolumeSpecName: "kube-api-access-v8cls") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "kube-api-access-v8cls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:23:17.906514 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.906498 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:23:17.906578 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.906565 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6694a648-cfac-42ec-a7e0-f2f17daefe6f" (UID: "6694a648-cfac-42ec-a7e0-f2f17daefe6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:23:17.987228 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.987190 2558 generic.go:356] "Generic (PLEG): container finished" podID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerID="79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4" exitCode=0 Jul 18 02:23:17.987396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.987247 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" Jul 18 02:23:17.987396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.987271 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" event={"ID":"6694a648-cfac-42ec-a7e0-f2f17daefe6f","Type":"ContainerDied","Data":"79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4"} Jul 18 02:23:17.987396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.987332 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh" event={"ID":"6694a648-cfac-42ec-a7e0-f2f17daefe6f","Type":"ContainerDied","Data":"ae92767e80e1f7696584a5bcf1d1b4a1f6f34b5e7ceaf89ac16e67af7e73f93c"} Jul 18 02:23:17.987396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.987355 2558 scope.go:117] "RemoveContainer" containerID="79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4" Jul 18 02:23:17.996784 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:17.996766 2558 scope.go:117] "RemoveContainer" containerID="72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367" Jul 18 02:23:18.004719 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.004700 2558 scope.go:117] "RemoveContainer" containerID="79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4" Jul 18 02:23:18.005029 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:23:18.005011 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4\": container with ID starting with 79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4 not found: ID does not exist" containerID="79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4" Jul 18 02:23:18.005090 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005038 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4"} err="failed to get container status \"79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4\": rpc error: code = NotFound desc = could not find container \"79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4\": container with ID starting with 79192851d06f68fb3c8e1253299191e416a1d6383471d017b18d00db3d17eaf4 not found: ID does not exist" Jul 18 02:23:18.005090 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005056 2558 scope.go:117] "RemoveContainer" containerID="72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367" Jul 18 02:23:18.005090 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005077 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005095 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005105 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005114 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8cls\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-kube-api-access-v8cls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005122 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005135 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005275 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005146 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6694a648-cfac-42ec-a7e0-f2f17daefe6f-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:23:18.005467 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:23:18.005316 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367\": container with ID starting with 72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367 not found: ID does not exist" containerID="72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367" Jul 18 02:23:18.005467 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.005338 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367"} err="failed to get container status \"72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367\": rpc error: code = NotFound desc = could not find container \"72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367\": container with ID starting with 72f095a4547d70fa8004f8ad28326e8227e21569d5449f7daaf72d36b8f84367 not found: ID does not exist" Jul 18 02:23:18.029961 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.025936 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh"] Jul 18 02:23:18.034975 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.034944 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-218ab5db-openshift-default-69dbb6bb75-d8fmh"] Jul 18 02:23:18.159582 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.159499 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:18.303578 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:18.303535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:19.735039 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:19.735005 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" path="/var/lib/kubelet/pods/6694a648-cfac-42ec-a7e0-f2f17daefe6f/volumes" Jul 18 02:23:27.615207 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:27.615163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:27.919228 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:27.919150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:28.160219 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:28.160189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:28.531207 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:28.531174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:23:54.512522 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:23:54.512487 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:04.395293 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:04.395242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:04.655088 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:04.655004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:04.894166 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:04.894133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:20.716734 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:20.716704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:22.931156 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:22.931123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:23.031527 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:23.031494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:27.426558 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:27.426506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:27.612245 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:27.612206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:27.733739 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:27.733688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:38.190109 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:38.190065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:39.028550 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:39.028516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:46.645101 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:46.645045 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:46.794543 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:46.794509 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:46.903132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:46.903052 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:47.034784 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:47.034747 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:47.904359 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:47.904316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:48.018455 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:48.018423 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:49.846196 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:49.846164 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:56.028521 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:56.028489 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:56.114993 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:56.114952 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:24:56.754536 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:24:56.754503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:04.485278 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:04.485239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:04.589603 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:04.589568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:04.738222 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:04.738131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:05.213715 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.213682 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq"] Jul 18 02:25:05.214018 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214005 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" Jul 18 02:25:05.214066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214020 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" Jul 18 02:25:05.214066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214034 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" Jul 18 02:25:05.214066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214040 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" Jul 18 02:25:05.214066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214051 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" Jul 18 02:25:05.214066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214059 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" Jul 18 02:25:05.214066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214064 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" Jul 18 02:25:05.214285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214070 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" Jul 18 02:25:05.214285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214119 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" Jul 18 02:25:05.214285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214127 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" Jul 18 02:25:05.214285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214132 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6694a648-cfac-42ec-a7e0-f2f17daefe6f" containerName="istio-proxy" Jul 18 02:25:05.214285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214138 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1908b14d-14e5-45db-a86a-5bf0ea798d39" containerName="istio-proxy" Jul 18 02:25:05.214285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.214147 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6432ff-f439-4f51-bd0c-aff49c2c353f" containerName="istio-proxy" Jul 18 02:25:05.216824 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.216806 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.224610 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.224587 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8d54aea0-openshift-default-dockercfg-pblwf\"" Jul 18 02:25:05.277486 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.277451 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:05.292321 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.292289 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq"] Jul 18 02:25:05.335730 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.335674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-envoy\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.335946 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.335780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-socket\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.335946 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.335824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-data\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.335946 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.335881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsxl\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-kube-api-access-ldsxl\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.336097 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.335962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-credential-socket\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.336097 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.335998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-certs\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.336097 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.336036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istiod-ca-cert\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.336244 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.336146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-token\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.336298 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.336257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-podinfo\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.437686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.437647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-podinfo\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.437865 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.437698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-envoy\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.437865 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.437723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-socket\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.437865 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.437744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-data\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438026 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.437996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsxl\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-kube-api-access-ldsxl\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438081 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438057 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-credential-socket\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438144 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-certs\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438144 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istiod-ca-cert\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438237 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-token\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438237 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-data\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438237 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-socket\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438461 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438437 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-credential-socket\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438512 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438447 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-certs\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.438784 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.438768 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istiod-ca-cert\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.440337 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.440317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-envoy\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.440561 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.440544 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-podinfo\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.446770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.446748 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsxl\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-kube-api-access-ldsxl\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.449088 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.449069 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-token\") pod \"e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.527335 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.527236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:05.684405 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.684371 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq"] Jul 18 02:25:05.687329 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:25:05.687304 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025b946d_6cb8_40b7_a18f_cbe276d9f22b.slice/crio-6e341327e8ffe544ad500a498e91b3443db8743d6bfd8cbbd8d23efe1dccb5a0 WatchSource:0}: Error finding container 6e341327e8ffe544ad500a498e91b3443db8743d6bfd8cbbd8d23efe1dccb5a0: Status 404 returned error can't find the container with id 6e341327e8ffe544ad500a498e91b3443db8743d6bfd8cbbd8d23efe1dccb5a0 Jul 18 02:25:05.689517 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.689483 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:25:05.689573 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.689555 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:25:05.689609 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.689584 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:25:05.706244 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:05.706217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:06.473683 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:06.473647 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" event={"ID":"025b946d-6cb8-40b7-a18f-cbe276d9f22b","Type":"ContainerStarted","Data":"432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc"} Jul 18 02:25:06.473874 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:06.473699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" event={"ID":"025b946d-6cb8-40b7-a18f-cbe276d9f22b","Type":"ContainerStarted","Data":"6e341327e8ffe544ad500a498e91b3443db8743d6bfd8cbbd8d23efe1dccb5a0"} Jul 18 02:25:06.507199 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:06.507148 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podStartSLOduration=1.507131818 podStartE2EDuration="1.507131818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:25:06.504687203 +0000 UTC m=+2063.291039269" watchObservedRunningTime="2026-07-18 02:25:06.507131818 +0000 UTC m=+2063.293483884" Jul 18 02:25:06.528421 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:06.528386 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:06.533429 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:06.533404 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:07.478137 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:07.478105 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:07.479032 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:07.479012 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:08.697834 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:08.697808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:08.938413 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:08.938377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:09.141893 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:09.141827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:09.336191 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:09.336128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:10.115352 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:10.115322 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:10.264455 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:10.264397 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:13.081854 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:13.081821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:13.750030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:13.749997 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:13.842357 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:13.842330 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:14.179519 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:14.179438 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:20.433944 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:20.433894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:20.503535 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:20.503505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:23.520090 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:23.520037 2558 patch_prober.go:28] interesting pod/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 18 02:25:23.522547 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:23.520113 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 18 02:25:24.559323 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:24.559292 2558 generic.go:356] "Generic (PLEG): container finished" podID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerID="432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc" exitCode=0 Jul 18 02:25:24.559725 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:24.559343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" event={"ID":"025b946d-6cb8-40b7-a18f-cbe276d9f22b","Type":"ContainerDied","Data":"432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc"} Jul 18 02:25:24.559766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:24.559749 2558 scope.go:117] "RemoveContainer" containerID="432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc" Jul 18 02:25:24.560835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:24.560805 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:25:24.560927 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:24.560890 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:25:24.560969 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:24.560957 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:25:25.566974 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:25.566938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" event={"ID":"025b946d-6cb8-40b7-a18f-cbe276d9f22b","Type":"ContainerStarted","Data":"506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952"} Jul 18 02:25:26.527518 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:26.527477 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:26.527773 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:26.527747 2558 patch_prober.go:28] interesting pod/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 18 02:25:26.527852 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:26.527804 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 18 02:25:27.527896 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:27.527856 2558 patch_prober.go:28] interesting pod/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 18 02:25:27.528492 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:27.527944 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 18 02:25:28.528163 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:28.528115 2558 patch_prober.go:28] interesting pod/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 18 02:25:28.528574 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:28.528178 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 18 02:25:29.531862 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:29.531831 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:29.532287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:29.532221 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:29.532985 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:29.532965 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:31.327886 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:31.327845 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:35.892620 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:35.892587 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:36.279246 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:36.279207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:42.414570 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:42.414501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:42.521161 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:42.521129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:42.692257 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:42.692167 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq"] Jul 18 02:25:42.692444 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:42.692422 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" containerID="cri-o://506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952" gracePeriod=30 Jul 18 02:25:42.719604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:42.719569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:42.941736 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:42.941705 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:43.059711 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:43.059681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:43.175039 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:43.175006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:43.299356 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:43.299322 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:44.535073 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:44.535037 2558 patch_prober.go:28] interesting pod/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:25:44.535465 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:44.535109 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:25:47.949360 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:47.949324 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:48.026197 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026162 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istiod-ca-cert\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026197 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026204 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-token\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026250 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldsxl\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-kube-api-access-ldsxl\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026278 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-socket\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026296 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-podinfo\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026315 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-envoy\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026336 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-certs\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026366 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-credential-socket\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026449 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026397 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-data\") pod \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\" (UID: \"025b946d-6cb8-40b7-a18f-cbe276d9f22b\") " Jul 18 02:25:48.026784 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026683 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:25:48.026784 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026709 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:25:48.026784 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026720 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:25:48.026995 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.026899 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:25:48.027667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.027641 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-data" (OuterVolumeSpecName: "istio-data") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:25:48.028869 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.028844 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:25:48.028986 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.028960 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-kube-api-access-ldsxl" (OuterVolumeSpecName: "kube-api-access-ldsxl") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "kube-api-access-ldsxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:25:48.029190 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.029163 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-token" (OuterVolumeSpecName: "istio-token") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:25:48.029285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.029180 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "025b946d-6cb8-40b7-a18f-cbe276d9f22b" (UID: "025b946d-6cb8-40b7-a18f-cbe276d9f22b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:25:48.127512 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127478 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127512 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127504 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127512 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127512 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldsxl\" (UniqueName: \"kubernetes.io/projected/025b946d-6cb8-40b7-a18f-cbe276d9f22b-kube-api-access-ldsxl\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127523 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127532 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127540 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127548 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127555 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.127780 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.127562 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025b946d-6cb8-40b7-a18f-cbe276d9f22b-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:25:48.675894 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.675859 2558 generic.go:356] "Generic (PLEG): container finished" podID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerID="506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952" exitCode=0 Jul 18 02:25:48.676101 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.675935 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" Jul 18 02:25:48.676101 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.675941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" event={"ID":"025b946d-6cb8-40b7-a18f-cbe276d9f22b","Type":"ContainerDied","Data":"506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952"} Jul 18 02:25:48.676101 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.675996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq" event={"ID":"025b946d-6cb8-40b7-a18f-cbe276d9f22b","Type":"ContainerDied","Data":"6e341327e8ffe544ad500a498e91b3443db8743d6bfd8cbbd8d23efe1dccb5a0"} Jul 18 02:25:48.676101 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.676018 2558 scope.go:117] "RemoveContainer" containerID="506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952" Jul 18 02:25:48.685121 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.685103 2558 scope.go:117] "RemoveContainer" containerID="432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc" Jul 18 02:25:48.693410 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.693388 2558 scope.go:117] "RemoveContainer" containerID="506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952" Jul 18 02:25:48.693672 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:25:48.693652 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952\": container with ID starting with 506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952 not found: ID does not exist" containerID="506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952" Jul 18 02:25:48.693736 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.693682 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952"} err="failed to get container status \"506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952\": rpc error: code = NotFound desc = could not find container \"506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952\": container with ID starting with 506d7c26f96a06043feaf5add616754476bdbadfe2fd23e6cccaa523bced4952 not found: ID does not exist" Jul 18 02:25:48.693736 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.693699 2558 scope.go:117] "RemoveContainer" containerID="432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc" Jul 18 02:25:48.693974 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:25:48.693954 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc\": container with ID starting with 432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc not found: ID does not exist" containerID="432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc" Jul 18 02:25:48.694024 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.693980 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc"} err="failed to get container status \"432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc\": rpc error: code = NotFound desc = could not find container \"432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc\": container with ID starting with 432b5dbbf539f8a98c5fd09b62149b351730000b85ded7a5fc3492af08c36bbc not found: ID does not exist" Jul 18 02:25:48.699133 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.699109 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq"] Jul 18 02:25:48.708719 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:48.708690 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8d54aea0-openshift-default-76994b5dc-rqhdq"] Jul 18 02:25:49.159149 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:49.159118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:49.267426 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:49.267382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:49.367497 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:49.367466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:49.531181 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:49.531155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:49.735350 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:49.735314 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" path="/var/lib/kubelet/pods/025b946d-6cb8-40b7-a18f-cbe276d9f22b/volumes" Jul 18 02:25:49.848625 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:49.848523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:55.317394 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:55.317359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:25:55.393594 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:25:55.393561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:02.140728 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.140683 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:02.435285 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.435197 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6"] Jul 18 02:26:02.435598 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.435580 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" Jul 18 02:26:02.435685 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.435601 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" Jul 18 02:26:02.435741 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.435695 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" Jul 18 02:26:02.435741 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.435707 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" Jul 18 02:26:02.440381 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.440355 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.442887 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.442859 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2adafcc9-openshift-default-dockercfg-br4m2\"" Jul 18 02:26:02.451134 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.451106 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6"] Jul 18 02:26:02.463113 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.463054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:02.557855 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.557820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-socket\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.557855 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.557856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-data\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.557876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3ecbeb-dedc-4767-a743-c379de9379be-istiod-ca-cert\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.557894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-podinfo\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.558003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-certs\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.558106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-envoy\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.558157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-credential-socket\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558392 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.558200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttgp\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-kube-api-access-2ttgp\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.558392 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.558224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-token\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.606257 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.606219 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:02.659774 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-credential-socket\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.659998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttgp\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-kube-api-access-2ttgp\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.659998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-token\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.659998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-socket\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.659998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-data\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.659998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3ecbeb-dedc-4767-a743-c379de9379be-istiod-ca-cert\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.659998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.659983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-podinfo\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.660331 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-certs\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.660331 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-envoy\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.660441 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660346 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-socket\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.660441 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660360 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-data\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.660652 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660626 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-certs\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.660727 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660661 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-credential-socket\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.661015 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.660986 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3ecbeb-dedc-4767-a743-c379de9379be-istiod-ca-cert\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.662723 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.662703 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-envoy\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.663132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.663113 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-podinfo\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.668793 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.668764 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttgp\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-kube-api-access-2ttgp\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.669007 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.668988 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-token\") pod \"e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.752025 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.751986 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:02.889774 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.889696 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6"] Jul 18 02:26:02.893593 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:26:02.893561 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3ecbeb_dedc_4767_a743_c379de9379be.slice/crio-05199cce5d5bc59fe6966a16d9d65fe38af68d65a88ca0d33610c054558fa3c6 WatchSource:0}: Error finding container 05199cce5d5bc59fe6966a16d9d65fe38af68d65a88ca0d33610c054558fa3c6: Status 404 returned error can't find the container with id 05199cce5d5bc59fe6966a16d9d65fe38af68d65a88ca0d33610c054558fa3c6 Jul 18 02:26:02.895652 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.895617 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:26:02.895738 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.895684 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:26:02.895738 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:02.895714 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:26:03.750063 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:03.750028 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" event={"ID":"ac3ecbeb-dedc-4767-a743-c379de9379be","Type":"ContainerStarted","Data":"68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e"} Jul 18 02:26:03.750457 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:03.750098 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" event={"ID":"ac3ecbeb-dedc-4767-a743-c379de9379be","Type":"ContainerStarted","Data":"05199cce5d5bc59fe6966a16d9d65fe38af68d65a88ca0d33610c054558fa3c6"} Jul 18 02:26:03.752357 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:03.752336 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:03.757678 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:03.757652 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:03.771100 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:03.771055 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" podStartSLOduration=1.771040781 podStartE2EDuration="1.771040781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:03.769432507 +0000 UTC m=+2120.555784574" watchObservedRunningTime="2026-07-18 02:26:03.771040781 +0000 UTC m=+2120.557392846" Jul 18 02:26:04.754818 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:04.754783 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:04.755721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:04.755703 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:05.737576 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:05.737539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:05.864201 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:05.864166 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:06.048658 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:06.048570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:06.274790 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:06.274759 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:06.609345 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:06.609314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:06.710056 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:06.710023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:10.182124 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:10.182058 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:18.837615 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:18.837507 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerID="68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e" exitCode=0 Jul 18 02:26:18.837615 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:18.837561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" event={"ID":"ac3ecbeb-dedc-4767-a743-c379de9379be","Type":"ContainerDied","Data":"68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e"} Jul 18 02:26:18.838093 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:18.837962 2558 scope.go:117] "RemoveContainer" containerID="68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e" Jul 18 02:26:18.838992 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:18.838960 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:26:18.839100 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:18.839048 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:26:18.839164 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:18.839098 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:26:19.755234 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:19.755201 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:19.843721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:19.843686 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" event={"ID":"ac3ecbeb-dedc-4767-a743-c379de9379be","Type":"ContainerStarted","Data":"eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449"} Jul 18 02:26:20.336531 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:20.336498 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:20.752672 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:20.752634 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:20.753802 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:20.753776 2558 patch_prober.go:28] interesting pod/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 18 02:26:20.753928 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:20.753823 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 18 02:26:21.753344 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:21.753304 2558 patch_prober.go:28] interesting pod/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 18 02:26:21.753772 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:21.753383 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 18 02:26:22.752774 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:22.752736 2558 patch_prober.go:28] interesting pod/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 18 02:26:22.752993 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:22.752793 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 18 02:26:23.752577 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:23.752538 2558 patch_prober.go:28] interesting pod/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 18 02:26:23.752994 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:23.752609 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 18 02:26:24.757087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:24.757056 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:24.757496 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:24.757330 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:24.758069 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:24.758049 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:26:53.963842 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:53.963812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:26:58.540679 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:26:58.540646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:00.836078 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:00.836047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:05.858076 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:05.858041 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:42.535317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:42.535287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:43.785457 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:43.785425 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:49.212389 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:49.212352 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:49.288359 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:49.288322 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:49.482628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:49.482545 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6"] Jul 18 02:27:49.482781 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:49.482737 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" containerID="cri-o://eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449" gracePeriod=30 Jul 18 02:27:49.511465 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:49.511429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:49.742251 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:49.742170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:50.820287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:50.820242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:50.918528 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:50.918491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:51.020957 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:51.020896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:51.767564 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:51.767536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:51.866828 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:51.866797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:51.973751 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:51.973720 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:53.452874 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:53.452819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:27:54.731789 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.731762 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:27:54.852446 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852359 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-data\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852446 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852400 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3ecbeb-dedc-4767-a743-c379de9379be-istiod-ca-cert\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852446 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852428 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-token\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852471 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-certs\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852512 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-envoy\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852571 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ttgp\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-kube-api-access-2ttgp\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852611 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-credential-socket\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852652 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-podinfo\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.852753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852699 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-socket\") pod \"ac3ecbeb-dedc-4767-a743-c379de9379be\" (UID: \"ac3ecbeb-dedc-4767-a743-c379de9379be\") " Jul 18 02:27:54.853087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852805 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3ecbeb-dedc-4767-a743-c379de9379be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:27:54.853087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.852885 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:27:54.853087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.853037 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:27:54.853200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.853090 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3ecbeb-dedc-4767-a743-c379de9379be-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.853200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.853102 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.853200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.853114 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.853200 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.853184 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:27:54.853341 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.853243 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:27:54.854953 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.854925 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:27:54.855078 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.854951 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-kube-api-access-2ttgp" (OuterVolumeSpecName: "kube-api-access-2ttgp") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "kube-api-access-2ttgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:27:54.855078 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.854999 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:27:54.855408 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.855389 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac3ecbeb-dedc-4767-a743-c379de9379be" (UID: "ac3ecbeb-dedc-4767-a743-c379de9379be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:27:54.954317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.954277 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.954317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.954309 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.954317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.954321 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.954553 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.954334 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ttgp\" (UniqueName: \"kubernetes.io/projected/ac3ecbeb-dedc-4767-a743-c379de9379be-kube-api-access-2ttgp\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.954553 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.954348 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3ecbeb-dedc-4767-a743-c379de9379be-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:54.954553 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:54.954359 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3ecbeb-dedc-4767-a743-c379de9379be-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:27:55.281556 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.281520 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerID="eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449" exitCode=0 Jul 18 02:27:55.281556 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.281555 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" Jul 18 02:27:55.281763 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.281568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" event={"ID":"ac3ecbeb-dedc-4767-a743-c379de9379be","Type":"ContainerDied","Data":"eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449"} Jul 18 02:27:55.281763 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.281619 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6" event={"ID":"ac3ecbeb-dedc-4767-a743-c379de9379be","Type":"ContainerDied","Data":"05199cce5d5bc59fe6966a16d9d65fe38af68d65a88ca0d33610c054558fa3c6"} Jul 18 02:27:55.281763 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.281643 2558 scope.go:117] "RemoveContainer" containerID="eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449" Jul 18 02:27:55.290632 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.290612 2558 scope.go:117] "RemoveContainer" containerID="68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e" Jul 18 02:27:55.298655 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.298635 2558 scope.go:117] "RemoveContainer" containerID="eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449" Jul 18 02:27:55.298935 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:27:55.298899 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449\": container with ID starting with eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449 not found: ID does not exist" containerID="eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449" Jul 18 02:27:55.298977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.298946 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449"} err="failed to get container status \"eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449\": rpc error: code = NotFound desc = could not find container \"eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449\": container with ID starting with eebdacdfcd9a8cecc4f02365e7496703da41b2c6c9ad1e513fc99e5a306c8449 not found: ID does not exist" Jul 18 02:27:55.298977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.298963 2558 scope.go:117] "RemoveContainer" containerID="68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e" Jul 18 02:27:55.299203 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:27:55.299188 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e\": container with ID starting with 68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e not found: ID does not exist" containerID="68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e" Jul 18 02:27:55.299244 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.299207 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e"} err="failed to get container status \"68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e\": rpc error: code = NotFound desc = could not find container \"68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e\": container with ID starting with 68e5f777bce4c70321d921255e7dc628c902f70482c76e19add6ca8037f16d3e not found: ID does not exist" Jul 18 02:27:55.303103 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.303065 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6"] Jul 18 02:27:55.308647 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.308622 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2adafcc9-openshift-default-9fdbb946c-2thp6"] Jul 18 02:27:55.735447 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:27:55.735417 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" path="/var/lib/kubelet/pods/ac3ecbeb-dedc-4767-a743-c379de9379be/volumes" Jul 18 02:28:00.015183 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:00.015135 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:00.108617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:00.108585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:00.700152 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:00.700117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:07.123023 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:07.122893 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:07.198350 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:07.198320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:07.295404 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:07.295362 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:17.875900 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:17.875861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:18.277499 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:18.277461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:19.463378 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:19.463341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:19.569005 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:19.568974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:39.219824 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:39.219789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:46.294380 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.294345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:46.405347 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.405315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:46.734447 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.734414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:46.987794 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.987698 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr"] Jul 18 02:28:46.988025 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988011 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" Jul 18 02:28:46.988025 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988025 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="025b946d-6cb8-40b7-a18f-cbe276d9f22b" containerName="istio-proxy" Jul 18 02:28:46.988175 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988035 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" Jul 18 02:28:46.988175 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988041 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" Jul 18 02:28:46.988175 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988054 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" Jul 18 02:28:46.988175 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988060 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" Jul 18 02:28:46.988175 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.988124 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" Jul 18 02:28:46.992242 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.992223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:46.994778 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:46.994756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-57b0da-openshift-default-dockercfg-xjzgn\"" Jul 18 02:28:47.013136 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.013103 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr"] Jul 18 02:28:47.020338 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-certs\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020499 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmr4\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-kube-api-access-lnmr4\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020499 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-data\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020499 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-podinfo\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e425a7-f2b1-4e7b-b70c-2509370dede3-istiod-ca-cert\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-token\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-socket\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020775 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-envoy\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.020775 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.020727 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-credential-socket\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.048570 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.048530 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:47.122086 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-certs\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122086 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmr4\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-kube-api-access-lnmr4\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-data\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-podinfo\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e425a7-f2b1-4e7b-b70c-2509370dede3-istiod-ca-cert\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-token\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-socket\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-envoy\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-credential-socket\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122818 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122504 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-certs\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122818 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-socket\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122986 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122820 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-data\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.122986 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-credential-socket\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.123065 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.122996 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e425a7-f2b1-4e7b-b70c-2509370dede3-istiod-ca-cert\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.124939 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.124898 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-podinfo\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.125007 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.124962 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-envoy\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.135384 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.135358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmr4\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-kube-api-access-lnmr4\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.135524 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.135502 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-token\") pod \"e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.303153 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.303058 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:47.376765 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.376727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:47.459460 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.459430 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr"] Jul 18 02:28:47.462077 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:28:47.462048 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e425a7_f2b1_4e7b_b70c_2509370dede3.slice/crio-f4d204555db86c1befc79feff8b9d73c92ea6c6c3326b22a6e0547dd44ff1adf WatchSource:0}: Error finding container f4d204555db86c1befc79feff8b9d73c92ea6c6c3326b22a6e0547dd44ff1adf: Status 404 returned error can't find the container with id f4d204555db86c1befc79feff8b9d73c92ea6c6c3326b22a6e0547dd44ff1adf Jul 18 02:28:47.464215 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.464181 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:28:47.464315 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.464260 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:28:47.464315 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.464303 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:28:47.519401 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:47.519368 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" event={"ID":"16e425a7-f2b1-4e7b-b70c-2509370dede3","Type":"ContainerStarted","Data":"f4d204555db86c1befc79feff8b9d73c92ea6c6c3326b22a6e0547dd44ff1adf"} Jul 18 02:28:48.525512 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:48.525479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" event={"ID":"16e425a7-f2b1-4e7b-b70c-2509370dede3","Type":"ContainerStarted","Data":"de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f"} Jul 18 02:28:48.551764 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:48.551688 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" podStartSLOduration=2.551670904 podStartE2EDuration="2.551670904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:28:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:28:48.550842638 +0000 UTC m=+2285.337194706" watchObservedRunningTime="2026-07-18 02:28:48.551670904 +0000 UTC m=+2285.338022974" Jul 18 02:28:49.303420 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:49.303389 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:49.308267 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:49.308240 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:49.530187 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:49.530153 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:49.531049 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:49.531026 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:28:50.568567 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:50.568536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:50.673237 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:50.673205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:50.958706 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:50.958668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:51.163635 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:51.163603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:51.885179 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:51.885140 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:51.987532 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:51.987505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:55.049596 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.049561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:55.390996 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.390877 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:55.688872 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.688793 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295"] Jul 18 02:28:55.689226 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.689212 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3ecbeb-dedc-4767-a743-c379de9379be" containerName="istio-proxy" Jul 18 02:28:55.692340 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.692322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.695100 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.695078 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f6c952-openshift-default-dockercfg-pzpkr\"" Jul 18 02:28:55.706971 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.706945 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295"] Jul 18 02:28:55.731626 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.731581 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:55.797541 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9169480d-7017-4a90-ae4f-bfa975745f12-istiod-ca-cert\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.797541 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-data\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.797781 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf9xx\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-kube-api-access-mf9xx\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.797781 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-certs\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.798001 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-socket\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.798001 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9169480d-7017-4a90-ae4f-bfa975745f12-istio-podinfo\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.798001 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-credential-socket\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.798001 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797965 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-envoy\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.798001 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.797995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-istio-token\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899125 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf9xx\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-kube-api-access-mf9xx\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899125 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-certs\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899381 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-socket\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899381 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9169480d-7017-4a90-ae4f-bfa975745f12-istio-podinfo\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899493 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-credential-socket\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899493 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-envoy\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899601 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-istio-token\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899601 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899516 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-socket\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899601 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9169480d-7017-4a90-ae4f-bfa975745f12-istiod-ca-cert\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899601 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899567 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-certs\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899601 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-data\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899841 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899748 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-credential-socket\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.899985 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.899964 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-data\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.900237 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.900215 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9169480d-7017-4a90-ae4f-bfa975745f12-istiod-ca-cert\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.901877 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.901854 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-envoy\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.902116 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.902099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9169480d-7017-4a90-ae4f-bfa975745f12-istio-podinfo\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.909573 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.909543 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf9xx\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-kube-api-access-mf9xx\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.910039 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.910008 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-istio-token\") pod \"e2e-inf-b-f6c952-openshift-default-69bf577557-g9295\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:55.944303 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:55.944218 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:56.002510 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.002472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:56.155670 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.155643 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295"] Jul 18 02:28:56.158281 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:28:56.158256 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9169480d_7017_4a90_ae4f_bfa975745f12.slice/crio-152dca740b108950e6ea9ea235ce3016ad91ed81a85e380efe8c76e763d6af6c WatchSource:0}: Error finding container 152dca740b108950e6ea9ea235ce3016ad91ed81a85e380efe8c76e763d6af6c: Status 404 returned error can't find the container with id 152dca740b108950e6ea9ea235ce3016ad91ed81a85e380efe8c76e763d6af6c Jul 18 02:28:56.160438 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.160403 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:28:56.160515 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.160474 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:28:56.160515 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.160504 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:28:56.562751 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.562657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" event={"ID":"9169480d-7017-4a90-ae4f-bfa975745f12","Type":"ContainerStarted","Data":"2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7"} Jul 18 02:28:56.562751 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:56.562712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" event={"ID":"9169480d-7017-4a90-ae4f-bfa975745f12","Type":"ContainerStarted","Data":"152dca740b108950e6ea9ea235ce3016ad91ed81a85e380efe8c76e763d6af6c"} Jul 18 02:28:57.003453 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:57.003417 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:57.008477 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:57.008445 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:57.139999 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:57.139944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podStartSLOduration=2.139926115 podStartE2EDuration="2.139926115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:28:56.595781938 +0000 UTC m=+2293.382134003" watchObservedRunningTime="2026-07-18 02:28:57.139926115 +0000 UTC m=+2293.926278171" Jul 18 02:28:57.567593 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:57.567564 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:57.568603 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:57.568583 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:28:58.643680 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:58.643646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:58.745876 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:58.745839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:58.909803 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:58.909716 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:59.114320 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:59.114269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:59.528954 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:59.528898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:28:59.629787 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:28:59.629754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:03.147066 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:03.147027 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:08.307508 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.307474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:08.631753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.631660 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerID="de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f" exitCode=0 Jul 18 02:29:08.631753 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.631733 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" event={"ID":"16e425a7-f2b1-4e7b-b70c-2509370dede3","Type":"ContainerDied","Data":"de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f"} Jul 18 02:29:08.632210 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.632189 2558 scope.go:117] "RemoveContainer" containerID="de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f" Jul 18 02:29:08.633460 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.633423 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:29:08.633549 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.633527 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:29:08.633596 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:08.633582 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:29:09.642654 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:09.642604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" event={"ID":"16e425a7-f2b1-4e7b-b70c-2509370dede3","Type":"ContainerStarted","Data":"96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d"} Jul 18 02:29:10.304498 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:10.304028 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:29:10.304498 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:10.304161 2558 patch_prober.go:28] interesting pod/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 02:29:10.304498 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:10.304204 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 02:29:11.303875 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:11.303839 2558 patch_prober.go:28] interesting pod/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 02:29:11.304534 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:11.304497 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 02:29:12.305176 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.304581 2558 patch_prober.go:28] interesting pod/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 02:29:12.305176 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.304684 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 02:29:12.568805 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.568721 2558 patch_prober.go:28] interesting pod/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 02:29:12.569012 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.568796 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 02:29:12.660082 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.659999 2558 generic.go:356] "Generic (PLEG): container finished" podID="9169480d-7017-4a90-ae4f-bfa975745f12" containerID="2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7" exitCode=0 Jul 18 02:29:12.660236 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.660073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" event={"ID":"9169480d-7017-4a90-ae4f-bfa975745f12","Type":"ContainerDied","Data":"2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7"} Jul 18 02:29:12.660511 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.660493 2558 scope.go:117] "RemoveContainer" containerID="2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7" Jul 18 02:29:12.661520 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.661492 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:29:12.661584 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.661563 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:29:12.661619 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:12.661593 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:29:13.222530 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:13.222504 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:13.303993 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:13.303951 2558 patch_prober.go:28] interesting pod/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 02:29:13.304199 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:13.304031 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 02:29:13.325448 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:13.325415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:13.665689 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:13.665603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" event={"ID":"9169480d-7017-4a90-ae4f-bfa975745f12","Type":"ContainerStarted","Data":"138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b"} Jul 18 02:29:14.003364 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:14.003269 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:29:14.004019 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:14.003662 2558 patch_prober.go:28] interesting pod/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 02:29:14.004019 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:14.003716 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 02:29:14.313845 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:14.313752 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:29:14.314306 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:14.314274 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:29:14.315220 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:14.315200 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:29:15.003506 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:15.003053 2558 patch_prober.go:28] interesting pod/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 02:29:15.003506 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:15.003118 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 02:29:16.003297 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:16.003257 2558 patch_prober.go:28] interesting pod/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 02:29:16.003617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:16.003585 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 02:29:17.003394 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:17.003349 2558 patch_prober.go:28] interesting pod/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 02:29:17.003592 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:17.003424 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 02:29:18.007802 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:18.007772 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:29:18.008293 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:18.008273 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:29:18.008882 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:18.008865 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:29:20.422742 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:20.422703 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:20.537128 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:20.537096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:36.879460 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:36.879376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:43.628944 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:43.628894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:43.732775 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:43.732740 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:56.687232 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:56.687199 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:57.660554 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:57.660528 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:58.421704 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:58.421668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:29:58.521569 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:29:58.521536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:05.620390 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:05.620352 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:08.473600 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:08.473563 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:12.857529 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:12.857485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:13.279624 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:13.279582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:19.907053 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:19.907018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:20.013181 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:20.013151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:20.196823 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:20.196736 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr"] Jul 18 02:30:20.197007 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:20.196968 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" containerID="cri-o://96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d" gracePeriod=30 Jul 18 02:30:20.210673 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:20.210642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:20.434445 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:20.434415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:21.126619 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:21.126583 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:21.222256 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:21.222215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:25.447707 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.447675 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:30:25.504123 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504026 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-data\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504123 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504074 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-token\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504123 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504105 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-podinfo\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504129 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-envoy\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504163 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-credential-socket\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504195 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-socket\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504251 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnmr4\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-kube-api-access-lnmr4\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.504403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504291 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-certs\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.505091 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504938 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e425a7-f2b1-4e7b-b70c-2509370dede3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:30:25.505091 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.504958 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-data" (OuterVolumeSpecName: "istio-data") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:25.505091 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.505030 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:25.505091 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.505074 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e425a7-f2b1-4e7b-b70c-2509370dede3-istiod-ca-cert\") pod \"16e425a7-f2b1-4e7b-b70c-2509370dede3\" (UID: \"16e425a7-f2b1-4e7b-b70c-2509370dede3\") " Jul 18 02:30:25.507037 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.506539 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.507037 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.506570 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e425a7-f2b1-4e7b-b70c-2509370dede3-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.507037 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.506594 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.507243 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.507078 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:25.507305 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.507275 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:25.512055 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.508985 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-kube-api-access-lnmr4" (OuterVolumeSpecName: "kube-api-access-lnmr4") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "kube-api-access-lnmr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:30:25.512829 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.512799 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:25.512955 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.512805 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:30:25.512955 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.512843 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-token" (OuterVolumeSpecName: "istio-token") pod "16e425a7-f2b1-4e7b-b70c-2509370dede3" (UID: "16e425a7-f2b1-4e7b-b70c-2509370dede3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:30:25.607305 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.607267 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.607305 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.607301 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnmr4\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-kube-api-access-lnmr4\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.607305 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.607312 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.607543 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.607321 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.607543 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.607329 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.607543 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.607336 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e425a7-f2b1-4e7b-b70c-2509370dede3-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:25.994743 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.994715 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerID="96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d" exitCode=0 Jul 18 02:30:25.994942 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.994780 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" Jul 18 02:30:25.994942 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.994800 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" event={"ID":"16e425a7-f2b1-4e7b-b70c-2509370dede3","Type":"ContainerDied","Data":"96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d"} Jul 18 02:30:25.994942 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.994860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr" event={"ID":"16e425a7-f2b1-4e7b-b70c-2509370dede3","Type":"ContainerDied","Data":"f4d204555db86c1befc79feff8b9d73c92ea6c6c3326b22a6e0547dd44ff1adf"} Jul 18 02:30:25.994942 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:25.994882 2558 scope.go:117] "RemoveContainer" containerID="96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d" Jul 18 02:30:26.003617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.003598 2558 scope.go:117] "RemoveContainer" containerID="de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f" Jul 18 02:30:26.011732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.011712 2558 scope.go:117] "RemoveContainer" containerID="96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d" Jul 18 02:30:26.012042 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:30:26.012020 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d\": container with ID starting with 96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d not found: ID does not exist" containerID="96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d" Jul 18 02:30:26.012111 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.012051 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d"} err="failed to get container status \"96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d\": rpc error: code = NotFound desc = could not find container \"96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d\": container with ID starting with 96d89e2e23f36d68ac60936b6fd4d7c333008e73820ebe44e537b842afdf237d not found: ID does not exist" Jul 18 02:30:26.012111 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.012069 2558 scope.go:117] "RemoveContainer" containerID="de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f" Jul 18 02:30:26.012318 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:30:26.012300 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f\": container with ID starting with de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f not found: ID does not exist" containerID="de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f" Jul 18 02:30:26.012377 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.012329 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f"} err="failed to get container status \"de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f\": rpc error: code = NotFound desc = could not find container \"de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f\": container with ID starting with de0c86d1f006ae3132c03a093d91bcbab8468adb75487773ed91eb24c01b117f not found: ID does not exist" Jul 18 02:30:26.021613 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.021583 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr"] Jul 18 02:30:26.026372 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:26.026346 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-57b0da-openshift-default-6555cfbf4c-6wqzr"] Jul 18 02:30:27.736016 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:27.735987 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" path="/var/lib/kubelet/pods/16e425a7-f2b1-4e7b-b70c-2509370dede3/volumes" Jul 18 02:30:31.142052 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:31.142015 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:35.658159 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:35.658124 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:36.040396 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:36.040368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:42.714890 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:42.714853 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:42.823720 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:42.823684 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:43.014932 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.014828 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295"] Jul 18 02:30:43.015100 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.015063 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" containerID="cri-o://138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b" gracePeriod=30 Jul 18 02:30:43.041457 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.041425 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:43.280782 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.280698 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:43.651662 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.651580 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:43.939832 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.939756 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl"] Jul 18 02:30:43.940262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.940130 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" Jul 18 02:30:43.940262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.940142 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" Jul 18 02:30:43.940262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.940151 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" Jul 18 02:30:43.940262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.940157 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" Jul 18 02:30:43.940262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.940208 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" Jul 18 02:30:43.940262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.940216 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e425a7-f2b1-4e7b-b70c-2509370dede3" containerName="istio-proxy" Jul 18 02:30:43.944604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.944586 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:43.947416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.947398 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b8fe6e-openshift-default-dockercfg-q8bkw\"" Jul 18 02:30:43.956841 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.956813 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl"] Jul 18 02:30:43.966328 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:43.966301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:44.075451 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-token\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075451 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-credential-socket\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-data\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-envoy\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fjb6\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-kube-api-access-2fjb6\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-podinfo\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istiod-ca-cert\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.075752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-certs\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.076106 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.075773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-socket\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177061 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-data\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177266 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-envoy\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177266 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fjb6\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-kube-api-access-2fjb6\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177266 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177126 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-podinfo\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177266 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istiod-ca-cert\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177266 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-certs\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177266 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-socket\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177577 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-token\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177577 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-credential-socket\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177577 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177561 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-data\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177735 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177622 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-socket\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.177735 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.177697 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-certs\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.178089 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.178066 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-credential-socket\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.178198 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.178173 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istiod-ca-cert\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.179534 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.179512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-envoy\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.179824 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.179805 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-podinfo\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.186528 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.186501 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-token\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.186848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.186824 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fjb6\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-kube-api-access-2fjb6\") pod \"e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.255087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.255059 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:44.343770 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.343699 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:44.397992 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.397966 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl"] Jul 18 02:30:44.400600 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:30:44.400571 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15353e8_3611_4e1f_aa8d_b0c8a4472a49.slice/crio-11080c7eba13aa1f467676003aa48c9e5b8b2a4bef6af0643c406ba2047a2b38 WatchSource:0}: Error finding container 11080c7eba13aa1f467676003aa48c9e5b8b2a4bef6af0643c406ba2047a2b38: Status 404 returned error can't find the container with id 11080c7eba13aa1f467676003aa48c9e5b8b2a4bef6af0643c406ba2047a2b38 Jul 18 02:30:44.402820 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.402785 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:30:44.402967 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.402875 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:30:44.402967 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:44.402941 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:30:45.083337 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:45.083297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" event={"ID":"b15353e8-3611-4e1f-aa8d-b0c8a4472a49","Type":"ContainerStarted","Data":"6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809"} Jul 18 02:30:45.083737 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:45.083369 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" event={"ID":"b15353e8-3611-4e1f-aa8d-b0c8a4472a49","Type":"ContainerStarted","Data":"11080c7eba13aa1f467676003aa48c9e5b8b2a4bef6af0643c406ba2047a2b38"} Jul 18 02:30:45.108472 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:45.108419 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podStartSLOduration=2.108401012 podStartE2EDuration="2.108401012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:45.105117684 +0000 UTC m=+2401.891469750" watchObservedRunningTime="2026-07-18 02:30:45.108401012 +0000 UTC m=+2401.894753082" Jul 18 02:30:45.256254 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:45.256211 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:45.257841 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:45.257819 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 02:30:45.257940 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:45.257869 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 02:30:46.260071 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:46.260041 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:47.092720 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:47.092689 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:47.093630 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:47.093613 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:30:47.253809 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:47.253780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:47.425974 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:47.425879 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:47.517220 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:47.517187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:48.011144 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.011103 2558 patch_prober.go:28] interesting pod/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:30:48.011317 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.011167 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:30:48.219065 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.219028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:48.265238 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.265171 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:30:48.376262 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.376228 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:48.419402 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419366 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-socket\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.419599 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419427 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf9xx\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-kube-api-access-mf9xx\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.419599 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419492 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9169480d-7017-4a90-ae4f-bfa975745f12-istiod-ca-cert\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.419599 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419537 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-data\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.419599 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419589 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-credential-socket\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419613 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-istio-token\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419641 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9169480d-7017-4a90-ae4f-bfa975745f12-istio-podinfo\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419670 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-envoy\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419688 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419700 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-certs\") pod \"9169480d-7017-4a90-ae4f-bfa975745f12\" (UID: \"9169480d-7017-4a90-ae4f-bfa975745f12\") " Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.419873 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.420028 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.420047 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.420099 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:48.420848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.420632 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-data" (OuterVolumeSpecName: "istio-data") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:48.421416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.420984 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9169480d-7017-4a90-ae4f-bfa975745f12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:30:48.422892 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.422485 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-istio-token" (OuterVolumeSpecName: "istio-token") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:30:48.422892 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.422528 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:30:48.423552 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.423518 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-kube-api-access-mf9xx" (OuterVolumeSpecName: "kube-api-access-mf9xx") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "kube-api-access-mf9xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:30:48.423804 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.423778 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9169480d-7017-4a90-ae4f-bfa975745f12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9169480d-7017-4a90-ae4f-bfa975745f12" (UID: "9169480d-7017-4a90-ae4f-bfa975745f12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520843 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9169480d-7017-4a90-ae4f-bfa975745f12-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520873 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520882 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520898 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9169480d-7017-4a90-ae4f-bfa975745f12-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520919 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520927 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9169480d-7017-4a90-ae4f-bfa975745f12-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:48.520956 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:48.520935 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf9xx\" (UniqueName: \"kubernetes.io/projected/9169480d-7017-4a90-ae4f-bfa975745f12-kube-api-access-mf9xx\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:30:49.103543 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.103509 2558 generic.go:356] "Generic (PLEG): container finished" podID="9169480d-7017-4a90-ae4f-bfa975745f12" containerID="138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b" exitCode=0 Jul 18 02:30:49.103735 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.103569 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" Jul 18 02:30:49.103735 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.103595 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" event={"ID":"9169480d-7017-4a90-ae4f-bfa975745f12","Type":"ContainerDied","Data":"138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b"} Jul 18 02:30:49.103735 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.103660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295" event={"ID":"9169480d-7017-4a90-ae4f-bfa975745f12","Type":"ContainerDied","Data":"152dca740b108950e6ea9ea235ce3016ad91ed81a85e380efe8c76e763d6af6c"} Jul 18 02:30:49.103735 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.103683 2558 scope.go:117] "RemoveContainer" containerID="138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b" Jul 18 02:30:49.113625 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.113602 2558 scope.go:117] "RemoveContainer" containerID="2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7" Jul 18 02:30:49.121843 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.121826 2558 scope.go:117] "RemoveContainer" containerID="138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b" Jul 18 02:30:49.122111 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:30:49.122092 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b\": container with ID starting with 138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b not found: ID does not exist" containerID="138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b" Jul 18 02:30:49.122156 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.122122 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b"} err="failed to get container status \"138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b\": rpc error: code = NotFound desc = could not find container \"138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b\": container with ID starting with 138a72bb1afc47b3261f55fa1f49151f74c3eca2586578e4f5f119bcb6cdab1b not found: ID does not exist" Jul 18 02:30:49.122156 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.122140 2558 scope.go:117] "RemoveContainer" containerID="2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7" Jul 18 02:30:49.122391 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:30:49.122372 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7\": container with ID starting with 2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7 not found: ID does not exist" containerID="2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7" Jul 18 02:30:49.122447 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.122402 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7"} err="failed to get container status \"2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7\": rpc error: code = NotFound desc = could not find container \"2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7\": container with ID starting with 2cb95ec9545e67edf278a5541679913ab46496e61027daed5afe100a074db8d7 not found: ID does not exist" Jul 18 02:30:49.132139 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.132109 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295"] Jul 18 02:30:49.141024 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.140980 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f6c952-openshift-default-69bf577557-g9295"] Jul 18 02:30:49.735975 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:49.735944 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" path="/var/lib/kubelet/pods/9169480d-7017-4a90-ae4f-bfa975745f12/volumes" Jul 18 02:30:51.542640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:51.542608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:52.000977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.000942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:52.308739 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.308660 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc"] Jul 18 02:30:52.309098 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.309080 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" Jul 18 02:30:52.309195 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.309099 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" Jul 18 02:30:52.309254 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.309198 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" Jul 18 02:30:52.309254 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.309211 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" Jul 18 02:30:52.313412 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.313391 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.315818 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.315800 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-acf914-openshift-default-dockercfg-ljls7\"" Jul 18 02:30:52.328355 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.328329 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc"] Jul 18 02:30:52.338126 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.338102 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:52.455383 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-socket\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455551 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-credential-socket\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455551 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istiod-ca-cert\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455551 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455464 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpv27\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-kube-api-access-vpv27\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-certs\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455604 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-podinfo\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455671 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-data\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455789 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-envoy\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.455789 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.455741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-token\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.556751 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-socket\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-credential-socket\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istiod-ca-cert\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv27\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-kube-api-access-vpv27\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-certs\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-podinfo\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-data\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.556994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-envoy\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.557022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-token\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557371 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.557259 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-socket\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557794 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.557306 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-certs\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557794 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.557762 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-credential-socket\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.557895 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.557841 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-data\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.558267 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.558235 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istiod-ca-cert\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.560669 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.560605 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-envoy\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.561118 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.561094 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-podinfo\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.566183 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.566158 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpv27\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-kube-api-access-vpv27\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.566580 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.566555 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-token\") pod \"e2e-api-b-acf914-openshift-default-b68544665-597zc\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.623284 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.623231 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:52.692677 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.692647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:52.769966 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.769936 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc"] Jul 18 02:30:52.772547 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:30:52.772523 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2803a60_3e69_4ea0_8b43_2467ec8c33e2.slice/crio-451b0cd95a8f67911876777a3da294402b7340833be6bf839d9b07737f35267a WatchSource:0}: Error finding container 451b0cd95a8f67911876777a3da294402b7340833be6bf839d9b07737f35267a: Status 404 returned error can't find the container with id 451b0cd95a8f67911876777a3da294402b7340833be6bf839d9b07737f35267a Jul 18 02:30:52.774774 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.774737 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:30:52.774865 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.774818 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:30:52.774904 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:52.774861 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:30:53.124450 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:53.124347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" event={"ID":"d2803a60-3e69-4ea0-8b43-2467ec8c33e2","Type":"ContainerStarted","Data":"083d7693f5decdeb829061f36666570f736cd2de8323e723b99fc1b5dee66e6b"} Jul 18 02:30:53.124450 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:53.124406 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" event={"ID":"d2803a60-3e69-4ea0-8b43-2467ec8c33e2","Type":"ContainerStarted","Data":"451b0cd95a8f67911876777a3da294402b7340833be6bf839d9b07737f35267a"} Jul 18 02:30:53.148293 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:53.148236 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podStartSLOduration=1.148218211 podStartE2EDuration="1.148218211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:53.147869266 +0000 UTC m=+2409.934221335" watchObservedRunningTime="2026-07-18 02:30:53.148218211 +0000 UTC m=+2409.934570278" Jul 18 02:30:53.624087 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:53.624044 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:53.629232 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:53.629205 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:54.129879 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:54.129849 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:54.131023 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:54.131004 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:30:55.121708 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:55.121651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:55.221623 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:55.221578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:55.436994 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:55.436853 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:55.576764 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:55.576727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:56.167938 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:56.167876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:56.259950 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:56.259876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:30:59.583988 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:30:59.583951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:02.434968 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:02.434940 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:58588->10.133.0.34:15021: read: connection reset by peer" start-of-body= Jul 18 02:31:02.435403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:02.435011 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:58588->10.133.0.34:15021: read: connection reset by peer" Jul 18 02:31:03.173071 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:03.173037 2558 generic.go:356] "Generic (PLEG): container finished" podID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerID="6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809" exitCode=0 Jul 18 02:31:03.173289 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:03.173120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" event={"ID":"b15353e8-3611-4e1f-aa8d-b0c8a4472a49","Type":"ContainerDied","Data":"6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809"} Jul 18 02:31:03.173585 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:03.173567 2558 scope.go:117] "RemoveContainer" containerID="6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809" Jul 18 02:31:03.174667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:03.174634 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:31:03.174720 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:03.174708 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:31:03.174773 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:03.174761 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:31:04.179794 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:04.179764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" event={"ID":"b15353e8-3611-4e1f-aa8d-b0c8a4472a49","Type":"ContainerStarted","Data":"9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60"} Jul 18 02:31:04.255245 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:04.255211 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:31:04.255740 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:04.255710 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 02:31:04.255883 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:04.255818 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 02:31:05.255857 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:05.255759 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 02:31:05.255857 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:05.255827 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 02:31:06.255798 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:06.255742 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 02:31:06.256009 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:06.255810 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 02:31:07.256278 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:07.256233 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 02:31:07.256762 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:07.256305 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 02:31:08.258860 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:08.258823 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:31:08.259267 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:08.259114 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:31:08.259885 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:08.259872 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:31:08.331108 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:08.331062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:08.422969 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:08.422928 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:10.173104 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:10.173056 2558 patch_prober.go:28] interesting pod/e2e-api-b-acf914-openshift-default-b68544665-597zc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 18 02:31:10.173634 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:10.173133 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 18 02:31:11.218715 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:11.218683 2558 generic.go:356] "Generic (PLEG): container finished" podID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerID="083d7693f5decdeb829061f36666570f736cd2de8323e723b99fc1b5dee66e6b" exitCode=0 Jul 18 02:31:11.219280 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:11.218760 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" event={"ID":"d2803a60-3e69-4ea0-8b43-2467ec8c33e2","Type":"ContainerDied","Data":"083d7693f5decdeb829061f36666570f736cd2de8323e723b99fc1b5dee66e6b"} Jul 18 02:31:11.219355 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:11.219296 2558 scope.go:117] "RemoveContainer" containerID="083d7693f5decdeb829061f36666570f736cd2de8323e723b99fc1b5dee66e6b" Jul 18 02:31:11.220358 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:11.220330 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:31:11.220460 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:11.220402 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:31:11.220460 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:11.220432 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:31:12.225673 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:12.225636 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" event={"ID":"d2803a60-3e69-4ea0-8b43-2467ec8c33e2","Type":"ContainerStarted","Data":"2529b28caaa8838868fad8ae7155f424c059a457219a0d2be5616913236a7fa1"} Jul 18 02:31:12.624137 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:12.624041 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:31:12.624289 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:12.624271 2558 patch_prober.go:28] interesting pod/e2e-api-b-acf914-openshift-default-b68544665-597zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 02:31:12.624345 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:12.624325 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 02:31:13.624480 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:13.624443 2558 patch_prober.go:28] interesting pod/e2e-api-b-acf914-openshift-default-b68544665-597zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 02:31:13.624888 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:13.624500 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 02:31:14.623890 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:14.623849 2558 patch_prober.go:28] interesting pod/e2e-api-b-acf914-openshift-default-b68544665-597zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 02:31:14.624132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:14.623943 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 02:31:15.624191 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:15.624150 2558 patch_prober.go:28] interesting pod/e2e-api-b-acf914-openshift-default-b68544665-597zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 02:31:15.624608 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:15.624211 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 02:31:16.628075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:16.628045 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:31:16.628505 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:16.628367 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:31:16.629001 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:16.628981 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:31:17.302164 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:17.302133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:17.404569 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:17.404538 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:23.256962 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:23.256903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:27.737663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:27.737633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:28.167064 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:28.166974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:34.130835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:34.130758 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:34.231631 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:34.231595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:34.383004 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:34.382903 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl"] Jul 18 02:31:34.383160 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:34.383136 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" containerID="cri-o://9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60" gracePeriod=30 Jul 18 02:31:34.406700 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:34.406662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:34.668973 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:34.668887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:38.261223 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:38.261179 2558 patch_prober.go:28] interesting pod/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:31:38.261602 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:38.261244 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:31:39.632044 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.632005 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:31:39.798710 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798672 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-envoy\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.798893 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798729 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-certs\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.798893 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798790 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-data\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.798893 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798829 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-credential-socket\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.798893 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798861 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-socket\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.799151 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798893 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istiod-ca-cert\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.799151 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.798963 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-token\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.799151 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799023 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-podinfo\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.799151 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799024 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:31:39.799151 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799055 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fjb6\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-kube-api-access-2fjb6\") pod \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\" (UID: \"b15353e8-3611-4e1f-aa8d-b0c8a4472a49\") " Jul 18 02:31:39.799408 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799209 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:31:39.799408 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799265 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:31:39.799514 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799411 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.799514 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799429 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.799514 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799448 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.799848 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799823 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-data" (OuterVolumeSpecName: "istio-data") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:31:39.799945 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.799864 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:31:39.801173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.801151 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:31:39.801403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.801385 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-token" (OuterVolumeSpecName: "istio-token") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:31:39.801776 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.801761 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-kube-api-access-2fjb6" (OuterVolumeSpecName: "kube-api-access-2fjb6") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "kube-api-access-2fjb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:31:39.801824 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.801782 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b15353e8-3611-4e1f-aa8d-b0c8a4472a49" (UID: "b15353e8-3611-4e1f-aa8d-b0c8a4472a49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:31:39.900637 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.900598 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.900637 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.900632 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.900637 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.900642 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.900637 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.900650 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.901026 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.900658 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fjb6\" (UniqueName: \"kubernetes.io/projected/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-kube-api-access-2fjb6\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:39.901026 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:39.900666 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15353e8-3611-4e1f-aa8d-b0c8a4472a49-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:31:40.362332 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.362298 2558 generic.go:356] "Generic (PLEG): container finished" podID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerID="9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60" exitCode=0 Jul 18 02:31:40.362529 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.362355 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" Jul 18 02:31:40.362529 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.362381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" event={"ID":"b15353e8-3611-4e1f-aa8d-b0c8a4472a49","Type":"ContainerDied","Data":"9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60"} Jul 18 02:31:40.362529 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.362439 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl" event={"ID":"b15353e8-3611-4e1f-aa8d-b0c8a4472a49","Type":"ContainerDied","Data":"11080c7eba13aa1f467676003aa48c9e5b8b2a4bef6af0643c406ba2047a2b38"} Jul 18 02:31:40.362529 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.362461 2558 scope.go:117] "RemoveContainer" containerID="9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60" Jul 18 02:31:40.372213 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.372194 2558 scope.go:117] "RemoveContainer" containerID="6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809" Jul 18 02:31:40.380339 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.380320 2558 scope.go:117] "RemoveContainer" containerID="9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60" Jul 18 02:31:40.380646 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:31:40.380625 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60\": container with ID starting with 9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60 not found: ID does not exist" containerID="9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60" Jul 18 02:31:40.380721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.380656 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60"} err="failed to get container status \"9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60\": rpc error: code = NotFound desc = could not find container \"9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60\": container with ID starting with 9d9321bb040e4cd29b324e47c0e8113d418801d485752ba70cadba7ef7560f60 not found: ID does not exist" Jul 18 02:31:40.380721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.380674 2558 scope.go:117] "RemoveContainer" containerID="6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809" Jul 18 02:31:40.380949 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:31:40.380931 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809\": container with ID starting with 6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809 not found: ID does not exist" containerID="6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809" Jul 18 02:31:40.381008 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.380955 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809"} err="failed to get container status \"6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809\": rpc error: code = NotFound desc = could not find container \"6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809\": container with ID starting with 6aed3879f1a6955f9afab5b1c70e3f181d8c1548d7d73e7a9bae166529a89809 not found: ID does not exist" Jul 18 02:31:40.387076 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.387047 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl"] Jul 18 02:31:40.395788 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:40.395764 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b8fe6e-openshift-default-c44c4cc47-wf6vl"] Jul 18 02:31:41.735083 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:41.735041 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" path="/var/lib/kubelet/pods/b15353e8-3611-4e1f-aa8d-b0c8a4472a49/volumes" Jul 18 02:31:50.218622 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:50.218591 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:54.864747 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:54.864707 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:31:55.250238 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:31:55.250208 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:01.070136 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.070098 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:01.171416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.171385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:01.334356 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.334267 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc"] Jul 18 02:32:01.334581 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.334557 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" containerID="cri-o://2529b28caaa8838868fad8ae7155f424c059a457219a0d2be5616913236a7fa1" gracePeriod=30 Jul 18 02:32:01.358366 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.358331 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:01.593707 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.593620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:01.630511 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.630476 2558 patch_prober.go:28] interesting pod/e2e-api-b-acf914-openshift-default-b68544665-597zc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:32:01.630670 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.630548 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:32:01.934463 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:01.934385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:02.222114 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222084 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4"] Jul 18 02:32:02.222604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222540 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" Jul 18 02:32:02.222604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222557 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" Jul 18 02:32:02.222604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222578 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" Jul 18 02:32:02.222604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222585 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" Jul 18 02:32:02.222604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222602 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" Jul 18 02:32:02.222855 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222611 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9169480d-7017-4a90-ae4f-bfa975745f12" containerName="istio-proxy" Jul 18 02:32:02.222855 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.222688 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" Jul 18 02:32:02.225372 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.225351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.228302 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.228279 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4b0cf7-openshift-default-dockercfg-hkxf9\"" Jul 18 02:32:02.238571 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.238546 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4"] Jul 18 02:32:02.252603 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.252580 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:02.289741 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.289703 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-credential-socket\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.289962 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.289758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istiod-ca-cert\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.289962 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.289792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfn5j\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-kube-api-access-vfn5j\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.289962 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.289841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-data\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.289962 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.289865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-envoy\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.290132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.289950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-certs\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.290132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.290001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-socket\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.290132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.290027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-token\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.290132 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.290086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-podinfo\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390685 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-data\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390685 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-envoy\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-certs\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-socket\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-token\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-podinfo\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-credential-socket\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istiod-ca-cert\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.390977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.390896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfn5j\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-kube-api-access-vfn5j\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393108 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393075 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-certs\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393215 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393149 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-socket\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393291 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393232 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-credential-socket\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393399 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393370 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-data\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393501 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393469 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istiod-ca-cert\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393635 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393611 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-podinfo\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.393700 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.393685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-envoy\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.399867 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.399846 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-token\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.400143 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.400121 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfn5j\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-kube-api-access-vfn5j\") pod \"e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.478779 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.478669 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:02.536032 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.535990 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:02.690437 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.690413 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4"] Jul 18 02:32:02.692460 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:32:02.692429 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1f5b5b_484f_4f65_811f_9bef1ada0814.slice/crio-85a9cdb791bf5ddc1d737829d23b6c7ec2e7cb0eae9d24ccfb9b06fcf67f5958 WatchSource:0}: Error finding container 85a9cdb791bf5ddc1d737829d23b6c7ec2e7cb0eae9d24ccfb9b06fcf67f5958: Status 404 returned error can't find the container with id 85a9cdb791bf5ddc1d737829d23b6c7ec2e7cb0eae9d24ccfb9b06fcf67f5958 Jul 18 02:32:02.694408 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.694367 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:02.694492 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.694432 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:02.694492 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:02.694459 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:03.469637 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:03.469600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" event={"ID":"ae1f5b5b-484f-4f65-811f-9bef1ada0814","Type":"ContainerStarted","Data":"e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc"} Jul 18 02:32:03.470182 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:03.469651 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" event={"ID":"ae1f5b5b-484f-4f65-811f-9bef1ada0814","Type":"ContainerStarted","Data":"85a9cdb791bf5ddc1d737829d23b6c7ec2e7cb0eae9d24ccfb9b06fcf67f5958"} Jul 18 02:32:03.490510 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:03.490404 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podStartSLOduration=1.490385985 podStartE2EDuration="1.490385985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:32:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:32:03.4901381 +0000 UTC m=+2480.276490168" watchObservedRunningTime="2026-07-18 02:32:03.490385985 +0000 UTC m=+2480.276738052" Jul 18 02:32:03.536331 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:03.536294 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:03.541230 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:03.541202 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:04.473807 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:04.473775 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:04.474686 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:04.474669 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:05.413339 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:05.413308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:05.508254 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:05.508222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:05.639626 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:05.639592 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:06.164541 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.164505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:06.266167 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.266138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:06.369766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.369739 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:06.485495 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.485464 2558 generic.go:356] "Generic (PLEG): container finished" podID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerID="2529b28caaa8838868fad8ae7155f424c059a457219a0d2be5616913236a7fa1" exitCode=0 Jul 18 02:32:06.485714 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.485546 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" event={"ID":"d2803a60-3e69-4ea0-8b43-2467ec8c33e2","Type":"ContainerDied","Data":"2529b28caaa8838868fad8ae7155f424c059a457219a0d2be5616913236a7fa1"} Jul 18 02:32:06.485714 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.485609 2558 scope.go:117] "RemoveContainer" containerID="083d7693f5decdeb829061f36666570f736cd2de8323e723b99fc1b5dee66e6b" Jul 18 02:32:06.575367 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.575343 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:32:06.631403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631371 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-data\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631403 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631405 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-token\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631431 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-envoy\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631462 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istiod-ca-cert\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631502 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-credential-socket\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631522 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-podinfo\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631552 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-socket\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631598 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-certs\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.631663 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631633 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpv27\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-kube-api-access-vpv27\") pod \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\" (UID: \"d2803a60-3e69-4ea0-8b43-2467ec8c33e2\") " Jul 18 02:32:06.632062 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631856 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:32:06.632062 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631873 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:32:06.632062 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631972 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:32:06.632062 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.631978 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.632468 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.632071 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.632468 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.632072 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:32:06.632468 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.632315 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:32:06.633800 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.633775 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:32:06.634213 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.634189 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-kube-api-access-vpv27" (OuterVolumeSpecName: "kube-api-access-vpv27") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "kube-api-access-vpv27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:32:06.634477 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.634459 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:32:06.634477 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.634464 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2803a60-3e69-4ea0-8b43-2467ec8c33e2" (UID: "d2803a60-3e69-4ea0-8b43-2467ec8c33e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:32:06.732438 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732407 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.732438 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732432 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.732438 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732440 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.732667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732450 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.732667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732458 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.732667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732466 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:06.732667 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:06.732474 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpv27\" (UniqueName: \"kubernetes.io/projected/d2803a60-3e69-4ea0-8b43-2467ec8c33e2-kube-api-access-vpv27\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:32:07.491161 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:07.491125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" event={"ID":"d2803a60-3e69-4ea0-8b43-2467ec8c33e2","Type":"ContainerDied","Data":"451b0cd95a8f67911876777a3da294402b7340833be6bf839d9b07737f35267a"} Jul 18 02:32:07.491352 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:07.491181 2558 scope.go:117] "RemoveContainer" containerID="2529b28caaa8838868fad8ae7155f424c059a457219a0d2be5616913236a7fa1" Jul 18 02:32:07.491352 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:07.491140 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc" Jul 18 02:32:07.517562 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:07.517531 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc"] Jul 18 02:32:07.522222 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:07.522196 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-acf914-openshift-default-b68544665-597zc"] Jul 18 02:32:07.736117 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:07.736082 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" path="/var/lib/kubelet/pods/d2803a60-3e69-4ea0-8b43-2467ec8c33e2/volumes" Jul 18 02:32:09.937925 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:09.937875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:10.261868 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.261836 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:10.546640 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.546559 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6"] Jul 18 02:32:10.546904 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.546888 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" Jul 18 02:32:10.547024 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.546903 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" Jul 18 02:32:10.547024 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.546954 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" Jul 18 02:32:10.547024 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.546959 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" Jul 18 02:32:10.547130 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.547027 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15353e8-3611-4e1f-aa8d-b0c8a4472a49" containerName="istio-proxy" Jul 18 02:32:10.547130 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.547037 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" Jul 18 02:32:10.547130 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.547044 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2803a60-3e69-4ea0-8b43-2467ec8c33e2" containerName="istio-proxy" Jul 18 02:32:10.551602 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.551582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.556286 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.556265 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-124cd9-openshift-default-dockercfg-75clc\"" Jul 18 02:32:10.570211 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.570176 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6"] Jul 18 02:32:10.602255 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.602222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:10.664430 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-certs\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664635 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-podinfo\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664635 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-credential-socket\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664773 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-socket\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664773 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-data\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664879 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664778 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npx2c\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-kube-api-access-npx2c\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664879 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-envoy\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.664879 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cfd0b21-e588-458c-bc29-74dfac745ef8-istiod-ca-cert\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.665051 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.664890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-token\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.765864 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.765823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-credential-socket\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.765864 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.765864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-socket\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.765884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-data\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.765956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npx2c\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-kube-api-access-npx2c\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.765989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-envoy\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766011 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cfd0b21-e588-458c-bc29-74dfac745ef8-istiod-ca-cert\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-token\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-certs\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-podinfo\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766572 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766334 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-socket\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766658 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766630 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-data\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766715 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766679 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-credential-socket\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.766881 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.766822 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-certs\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.767030 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.767011 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cfd0b21-e588-458c-bc29-74dfac745ef8-istiod-ca-cert\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.768647 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.768625 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-envoy\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.768746 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.768729 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-podinfo\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.774701 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.774674 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-token\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.774837 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.774764 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npx2c\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-kube-api-access-npx2c\") pod \"e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.861990 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.861846 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:10.950566 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:10.950535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:11.007408 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.007188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6"] Jul 18 02:32:11.012288 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:32:11.012260 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfd0b21_e588_458c_bc29_74dfac745ef8.slice/crio-9e732c26581ea6ed904303b359b280d5260598089dc9cc5c43bb9a7c9637cf79 WatchSource:0}: Error finding container 9e732c26581ea6ed904303b359b280d5260598089dc9cc5c43bb9a7c9637cf79: Status 404 returned error can't find the container with id 9e732c26581ea6ed904303b359b280d5260598089dc9cc5c43bb9a7c9637cf79 Jul 18 02:32:11.014269 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.014239 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:11.014335 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.014307 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:11.014372 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.014337 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:11.513291 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.513252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" event={"ID":"0cfd0b21-e588-458c-bc29-74dfac745ef8","Type":"ContainerStarted","Data":"6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625"} Jul 18 02:32:11.513510 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.513312 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" event={"ID":"0cfd0b21-e588-458c-bc29-74dfac745ef8","Type":"ContainerStarted","Data":"9e732c26581ea6ed904303b359b280d5260598089dc9cc5c43bb9a7c9637cf79"} Jul 18 02:32:11.537901 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.537848 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" podStartSLOduration=1.537831868 podStartE2EDuration="1.537831868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:32:11.536428025 +0000 UTC m=+2488.322780090" watchObservedRunningTime="2026-07-18 02:32:11.537831868 +0000 UTC m=+2488.324183935" Jul 18 02:32:11.862335 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:11.862240 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:12.868290 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:12.868259 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:13.444922 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:13.444887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:13.523593 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:13.523564 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:13.524439 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:13.524421 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:13.555536 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:13.555483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:13.750828 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:13.750789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:14.234717 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:14.234679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:14.406532 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:14.406489 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:14.506042 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:14.505894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:17.944623 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:17.944590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:20.516205 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:20.516158 2558 patch_prober.go:28] interesting pod/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 18 02:32:20.516855 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:20.516799 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 18 02:32:20.732688 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:20.732653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:21.562222 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:21.562191 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerID="e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc" exitCode=0 Jul 18 02:32:21.562222 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:21.562225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" event={"ID":"ae1f5b5b-484f-4f65-811f-9bef1ada0814","Type":"ContainerDied","Data":"e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc"} Jul 18 02:32:21.562721 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:21.562621 2558 scope.go:117] "RemoveContainer" containerID="e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc" Jul 18 02:32:21.563752 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:21.563713 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:21.563877 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:21.563818 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:21.563985 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:21.563873 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:22.569202 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:22.569170 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" event={"ID":"ae1f5b5b-484f-4f65-811f-9bef1ada0814","Type":"ContainerStarted","Data":"db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57"} Jul 18 02:32:23.537441 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:23.537394 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:23.537668 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:23.537538 2558 patch_prober.go:28] interesting pod/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 02:32:23.537668 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:23.537599 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 02:32:24.537077 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:24.537038 2558 patch_prober.go:28] interesting pod/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 02:32:24.537491 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:24.537101 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 02:32:25.537274 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:25.537232 2558 patch_prober.go:28] interesting pod/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 02:32:25.537703 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:25.537299 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 02:32:26.540004 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:26.539973 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:26.540441 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:26.540254 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:26.541097 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:26.541077 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:32:26.944181 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:26.944034 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:27.049945 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.049865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:27.209015 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.208975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:27.596043 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.596017 2558 generic.go:356] "Generic (PLEG): container finished" podID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerID="6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625" exitCode=0 Jul 18 02:32:27.596414 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.596088 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" event={"ID":"0cfd0b21-e588-458c-bc29-74dfac745ef8","Type":"ContainerDied","Data":"6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625"} Jul 18 02:32:27.596541 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.596527 2558 scope.go:117] "RemoveContainer" containerID="6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625" Jul 18 02:32:27.597600 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.597575 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:27.597657 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.597644 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:27.597693 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:27.597683 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 18 02:32:28.523591 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:28.523560 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:28.607260 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:28.607214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" event={"ID":"0cfd0b21-e588-458c-bc29-74dfac745ef8","Type":"ContainerStarted","Data":"46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1"} Jul 18 02:32:28.863048 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:28.862950 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:28.864228 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:28.864202 2558 patch_prober.go:28] interesting pod/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 18 02:32:28.864345 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:28.864253 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 18 02:32:29.862676 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:29.862637 2558 patch_prober.go:28] interesting pod/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 18 02:32:29.863180 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:29.862707 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 18 02:32:30.862689 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:30.862644 2558 patch_prober.go:28] interesting pod/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 18 02:32:30.863147 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:30.862712 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 18 02:32:31.862599 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:31.862560 2558 patch_prober.go:28] interesting pod/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 18 02:32:31.862788 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:31.862625 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 18 02:32:32.866775 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:32.866740 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:32.867248 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:32.867123 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:32.867962 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:32.867898 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:32:36.291462 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:36.291351 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:36.393711 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:36.393645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:36.686127 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:36.686044 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:32:58.760208 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:32:58.760173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:33:20.387321 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:33:20.387283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:33:20.486604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:33:20.486570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:33:58.548924 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:33:58.548881 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:34:10.816805 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:34:10.816730 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:34:10.916800 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:34:10.916768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:34:55.723140 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:34:55.723101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:34:56.703353 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:34:56.703310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:35:06.991410 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:35:06.991376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:35:07.089691 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:35:07.089660 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:35:18.152141 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:35:18.152106 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:35:22.777836 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:35:22.777799 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:35:49.286835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:35:49.286758 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:36:23.622972 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:36:23.622933 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:36:24.525688 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:36:24.525658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:36:38.125889 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:36:38.125860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:05.362117 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:05.362036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:27.848596 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:27.848562 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:27.950518 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:27.950464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:37.221481 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:37.221447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:37.322832 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:37.322795 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:43.859390 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:43.859356 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:37:44.706309 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:37:44.706275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:04.654118 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:04.654082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:05.717076 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:05.717046 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:14.598937 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:14.598886 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:19.206801 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:19.206768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:19.608704 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:19.608624 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:21.142007 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:21.141967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:21.241836 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:21.241804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:25.992826 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:25.992792 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:26.092628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.092586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:26.234507 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.234470 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4"] Jul 18 02:38:26.234751 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.234725 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" containerID="cri-o://db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57" gracePeriod=30 Jul 18 02:38:26.258593 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.258500 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:26.466760 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.466727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:26.542877 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.542793 2558 patch_prober.go:28] interesting pod/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:38:26.542877 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:26.542860 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:38:27.116790 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:27.116755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:27.215345 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:27.215315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:31.482612 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.482586 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:38:31.597320 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597233 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-socket\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597320 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597284 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfn5j\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-kube-api-access-vfn5j\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597320 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597315 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-podinfo\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597340 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istiod-ca-cert\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597399 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-token\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597422 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-data\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597445 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-certs\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597470 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-credential-socket\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597493 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-envoy\") pod \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\" (UID: \"ae1f5b5b-484f-4f65-811f-9bef1ada0814\") " Jul 18 02:38:31.597713 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597536 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:31.598095 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597720 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:31.598095 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597728 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.598095 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597844 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:38:31.598095 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.597991 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:31.598853 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.598823 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:31.599851 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.599822 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:38:31.599977 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.599945 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:31.600069 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.600050 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:38:31.600109 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.600083 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-kube-api-access-vfn5j" (OuterVolumeSpecName: "kube-api-access-vfn5j") pod "ae1f5b5b-484f-4f65-811f-9bef1ada0814" (UID: "ae1f5b5b-484f-4f65-811f-9bef1ada0814"). InnerVolumeSpecName "kube-api-access-vfn5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:38:31.698585 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698542 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698585 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698574 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698585 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698584 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698585 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698593 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698601 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698611 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfn5j\" (UniqueName: \"kubernetes.io/projected/ae1f5b5b-484f-4f65-811f-9bef1ada0814-kube-api-access-vfn5j\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698619 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:31.698859 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:31.698627 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1f5b5b-484f-4f65-811f-9bef1ada0814-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:32.306255 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.306214 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerID="db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57" exitCode=0 Jul 18 02:38:32.306470 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.306280 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" Jul 18 02:38:32.306470 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.306309 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" event={"ID":"ae1f5b5b-484f-4f65-811f-9bef1ada0814","Type":"ContainerDied","Data":"db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57"} Jul 18 02:38:32.306470 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.306380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4" event={"ID":"ae1f5b5b-484f-4f65-811f-9bef1ada0814","Type":"ContainerDied","Data":"85a9cdb791bf5ddc1d737829d23b6c7ec2e7cb0eae9d24ccfb9b06fcf67f5958"} Jul 18 02:38:32.306470 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.306410 2558 scope.go:117] "RemoveContainer" containerID="db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57" Jul 18 02:38:32.315034 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.315016 2558 scope.go:117] "RemoveContainer" containerID="e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc" Jul 18 02:38:32.323601 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.323568 2558 scope.go:117] "RemoveContainer" containerID="db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57" Jul 18 02:38:32.323891 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:38:32.323871 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57\": container with ID starting with db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57 not found: ID does not exist" containerID="db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57" Jul 18 02:38:32.323998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.323900 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57"} err="failed to get container status \"db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57\": rpc error: code = NotFound desc = could not find container \"db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57\": container with ID starting with db7e4d910b88acaaf677012df6958e9283873ca3cc024082b5cdb2ef3a6abb57 not found: ID does not exist" Jul 18 02:38:32.323998 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.323939 2558 scope.go:117] "RemoveContainer" containerID="e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc" Jul 18 02:38:32.324230 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:38:32.324208 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc\": container with ID starting with e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc not found: ID does not exist" containerID="e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc" Jul 18 02:38:32.324277 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.324240 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc"} err="failed to get container status \"e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc\": rpc error: code = NotFound desc = could not find container \"e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc\": container with ID starting with e111f588624791d1f5976495b86630b6d8232df86c7feac2b6a2282e6c0d9ddc not found: ID does not exist" Jul 18 02:38:32.325426 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.325408 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4"] Jul 18 02:38:32.330216 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:32.330192 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4b0cf7-openshift-default-ff76f6cc5-bgss4"] Jul 18 02:38:33.735067 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:33.735038 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" path="/var/lib/kubelet/pods/ae1f5b5b-484f-4f65-811f-9bef1ada0814/volumes" Jul 18 02:38:37.109153 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:37.109072 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:41.656592 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:41.656543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:42.039293 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:42.039251 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:48.256106 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:48.256066 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:48.356657 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:48.356628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:48.504595 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:48.504558 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6"] Jul 18 02:38:48.504822 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:48.504798 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" containerID="cri-o://46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1" gracePeriod=30 Jul 18 02:38:48.525466 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:48.525369 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:48.771178 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:48.771123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:38:53.756617 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.756591 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:38:53.900067 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.899970 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cfd0b21-e588-458c-bc29-74dfac745ef8-istiod-ca-cert\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900067 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900020 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-credential-socket\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900067 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900056 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-data\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900327 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900077 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-token\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900327 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900110 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-podinfo\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900327 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900156 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npx2c\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-kube-api-access-npx2c\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900327 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900181 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-socket\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900327 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900248 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-certs\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900327 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900271 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-envoy\") pod \"0cfd0b21-e588-458c-bc29-74dfac745ef8\" (UID: \"0cfd0b21-e588-458c-bc29-74dfac745ef8\") " Jul 18 02:38:53.900628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900406 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:53.900628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900492 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cfd0b21-e588-458c-bc29-74dfac745ef8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:38:53.900628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900506 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:53.900628 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900607 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cfd0b21-e588-458c-bc29-74dfac745ef8-istiod-ca-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:53.900835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900662 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-credential-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:53.900835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900682 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-socket\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:53.900835 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900690 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:53.901205 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.900997 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:53.902687 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.902652 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 02:38:53.902687 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.902674 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-kube-api-access-npx2c" (OuterVolumeSpecName: "kube-api-access-npx2c") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "kube-api-access-npx2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:38:53.902687 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.902665 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:38:53.902890 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:53.902774 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0cfd0b21-e588-458c-bc29-74dfac745ef8" (UID: "0cfd0b21-e588-458c-bc29-74dfac745ef8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:38:54.001454 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.001399 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npx2c\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-kube-api-access-npx2c\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:54.001454 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.001446 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-workload-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:54.001454 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.001461 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-envoy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:54.001709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.001473 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-data\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:54.001709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.001484 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:54.001709 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.001494 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cfd0b21-e588-458c-bc29-74dfac745ef8-istio-podinfo\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\"" Jul 18 02:38:54.408227 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.408192 2558 generic.go:356] "Generic (PLEG): container finished" podID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerID="46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1" exitCode=0 Jul 18 02:38:54.408416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.408231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" event={"ID":"0cfd0b21-e588-458c-bc29-74dfac745ef8","Type":"ContainerDied","Data":"46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1"} Jul 18 02:38:54.408416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.408289 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" event={"ID":"0cfd0b21-e588-458c-bc29-74dfac745ef8","Type":"ContainerDied","Data":"9e732c26581ea6ed904303b359b280d5260598089dc9cc5c43bb9a7c9637cf79"} Jul 18 02:38:54.408416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.408311 2558 scope.go:117] "RemoveContainer" containerID="46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1" Jul 18 02:38:54.408416 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.408243 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6" Jul 18 02:38:54.417542 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.417525 2558 scope.go:117] "RemoveContainer" containerID="6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625" Jul 18 02:38:54.425530 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.425511 2558 scope.go:117] "RemoveContainer" containerID="46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1" Jul 18 02:38:54.425785 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:38:54.425764 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1\": container with ID starting with 46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1 not found: ID does not exist" containerID="46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1" Jul 18 02:38:54.425840 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.425793 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1"} err="failed to get container status \"46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1\": rpc error: code = NotFound desc = could not find container \"46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1\": container with ID starting with 46093d1af3644ded71ccdb010a9f77a3919ac68467c467552f22fc2e695c90e1 not found: ID does not exist" Jul 18 02:38:54.425840 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.425811 2558 scope.go:117] "RemoveContainer" containerID="6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625" Jul 18 02:38:54.426111 ip-10-0-143-37 kubenswrapper[2558]: E0718 02:38:54.426085 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625\": container with ID starting with 6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625 not found: ID does not exist" containerID="6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625" Jul 18 02:38:54.426191 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.426119 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625"} err="failed to get container status \"6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625\": rpc error: code = NotFound desc = could not find container \"6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625\": container with ID starting with 6874e13d3b55023e1784eb2f7dcf2fbe4db920935d5dac73c6085371206fe625 not found: ID does not exist" Jul 18 02:38:54.429944 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.429901 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6"] Jul 18 02:38:54.436672 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.436650 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-124cd9-openshift-default-6999dd8979-nclv6"] Jul 18 02:38:54.946441 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:54.946417 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fw2t8_2f3083fc-7f40-437c-bf92-dde79ac08249/server/0.log" Jul 18 02:38:55.184272 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:55.184243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-5cpp8_27333d8c-0d3d-4799-8d21-53016498b315/copy-manifests/0.log" Jul 18 02:38:55.191935 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:55.191890 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-5cpp8_27333d8c-0d3d-4799-8d21-53016498b315/manager/0.log" Jul 18 02:38:55.734885 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:55.734849 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" path="/var/lib/kubelet/pods/0cfd0b21-e588-458c-bc29-74dfac745ef8/volumes" Jul 18 02:38:58.699480 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:58.699449 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jw55q_45d9b577-58d9-499b-be02-f15aa5819768/istio-proxy/0.log" Jul 18 02:38:58.828407 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:58.828374 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-z4vkf_f15d3416-3aa4-4903-bd71-3c12b09008d7/discovery/0.log" Jul 18 02:38:59.185282 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:59.185253 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/1.log" Jul 18 02:38:59.900957 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:38:59.900899 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hnj55_0c388f18-b905-4355-a924-f2d565fc948f/main/0.log" Jul 18 02:39:00.376954 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:00.376901 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nbw59_b36788fe-5547-432c-91a2-29e309b5f62a/main/0.log" Jul 18 02:39:05.991618 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:05.991568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:39:06.085150 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:06.085123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" limit=1024 Jul 18 02:39:08.856756 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:08.856716 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4pldj_4d57b1ce-222a-4d3b-86b6-eab154dec7a2/global-pull-secret-syncer/0.log" Jul 18 02:39:08.992920 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:08.992875 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nj9cp_cc825f9e-f2e7-4396-82df-23a1a8a56b29/konnectivity-agent/0.log" Jul 18 02:39:09.140691 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:09.140614 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-37.ec2.internal_7806e5900852888ca28273b89b72f3a8/haproxy/0.log" Jul 18 02:39:16.071085 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.071049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctq8k_6c9725a2-7e1e-40fd-9e98-1403c7fb978e/node-exporter/0.log" Jul 18 02:39:16.091428 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.091401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctq8k_6c9725a2-7e1e-40fd-9e98-1403c7fb978e/kube-rbac-proxy/0.log" Jul 18 02:39:16.111272 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.111249 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctq8k_6c9725a2-7e1e-40fd-9e98-1403c7fb978e/init-textfile/0.log" Jul 18 02:39:16.329293 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.329220 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mp7ff_fa167200-33d2-4b18-adc4-1d5cb0051754/kube-rbac-proxy-main/0.log" Jul 18 02:39:16.351492 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.351459 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mp7ff_fa167200-33d2-4b18-adc4-1d5cb0051754/kube-rbac-proxy-self/0.log" Jul 18 02:39:16.374841 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.374814 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mp7ff_fa167200-33d2-4b18-adc4-1d5cb0051754/openshift-state-metrics/0.log" Jul 18 02:39:16.695892 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:16.695847 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-q24qc_8bf91fa4-1ad9-4aa8-ab56-f35204d29b89/prometheus-operator-admission-webhook/0.log" Jul 18 02:39:19.016323 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016282 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd"] Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016612 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016624 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016631 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016637 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016650 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016656 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016664 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016669 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" Jul 18 02:39:19.016732 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016734 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae1f5b5b-484f-4f65-811f-9bef1ada0814" containerName="istio-proxy" Jul 18 02:39:19.017059 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016743 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" Jul 18 02:39:19.017059 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.016750 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cfd0b21-e588-458c-bc29-74dfac745ef8" containerName="istio-proxy" Jul 18 02:39:19.021083 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.021060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.023425 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.023396 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsnmv\"/\"kube-root-ca.crt\"" Jul 18 02:39:19.024476 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.024445 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsnmv\"/\"default-dockercfg-wpgd5\"" Jul 18 02:39:19.024616 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.024449 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsnmv\"/\"openshift-service-ca.crt\"" Jul 18 02:39:19.029800 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.029777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd"] Jul 18 02:39:19.127287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.127252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-sys\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.127287 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.127288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-lib-modules\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.127524 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.127309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdq6\" (UniqueName: \"kubernetes.io/projected/827d194b-7665-4c0d-a870-d599b0e380c2-kube-api-access-4kdq6\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.127524 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.127367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-podres\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.127524 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.127423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-proc\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.228766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdq6\" (UniqueName: \"kubernetes.io/projected/827d194b-7665-4c0d-a870-d599b0e380c2-kube-api-access-4kdq6\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.228766 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-podres\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-proc\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-sys\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-lib-modules\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228955 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-podres\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228978 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-proc\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229031 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.228994 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-sys\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.229229 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.229032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/827d194b-7665-4c0d-a870-d599b0e380c2-lib-modules\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.237276 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.237247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdq6\" (UniqueName: \"kubernetes.io/projected/827d194b-7665-4c0d-a870-d599b0e380c2-kube-api-access-4kdq6\") pod \"perf-node-gather-daemonset-ft8dd\" (UID: \"827d194b-7665-4c0d-a870-d599b0e380c2\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.333173 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.333073 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:19.469642 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.469611 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd"] Jul 18 02:39:19.473873 ip-10-0-143-37 kubenswrapper[2558]: W0718 02:39:19.473840 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod827d194b_7665_4c0d_a870_d599b0e380c2.slice/crio-553072a180a89952988752d071ca5ce58bce15738df5403ee259c9fc3fba3c8a WatchSource:0}: Error finding container 553072a180a89952988752d071ca5ce58bce15738df5403ee259c9fc3fba3c8a: Status 404 returned error can't find the container with id 553072a180a89952988752d071ca5ce58bce15738df5403ee259c9fc3fba3c8a Jul 18 02:39:19.481844 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.481819 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-gfh7b_db2267fc-474a-403e-a122-da141b49a50d/download-server/0.log" Jul 18 02:39:19.530549 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:19.530524 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" event={"ID":"827d194b-7665-4c0d-a870-d599b0e380c2","Type":"ContainerStarted","Data":"553072a180a89952988752d071ca5ce58bce15738df5403ee259c9fc3fba3c8a"} Jul 18 02:39:20.536373 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:20.536338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" event={"ID":"827d194b-7665-4c0d-a870-d599b0e380c2","Type":"ContainerStarted","Data":"f7715626f6bacd4d0c737c36325a5b1b7644fd180443c726bbfd049f41e716e2"} Jul 18 02:39:20.536779 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:20.536415 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:20.552832 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:20.552771 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" podStartSLOduration=1.55275098 podStartE2EDuration="1.55275098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:39:20.552165066 +0000 UTC m=+2917.338517154" watchObservedRunningTime="2026-07-18 02:39:20.55275098 +0000 UTC m=+2917.339103043" Jul 18 02:39:21.103357 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:21.103327 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9lmgp_6dc575c1-b702-446e-bea4-946ef1b61aef/dns/0.log" Jul 18 02:39:21.124806 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:21.124779 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9lmgp_6dc575c1-b702-446e-bea4-946ef1b61aef/kube-rbac-proxy/0.log" Jul 18 02:39:21.250211 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:21.250182 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-88q8q_389df2b1-9df6-40ce-a56f-55ca438a7ac9/dns-node-resolver/0.log" Jul 18 02:39:21.919291 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:21.919258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjq2t_1d22e758-50ad-4cc5-8311-4382fe4b8669/node-ca/0.log" Jul 18 02:39:22.842700 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:22.842668 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jw55q_45d9b577-58d9-499b-be02-f15aa5819768/istio-proxy/0.log" Jul 18 02:39:22.971448 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:22.971414 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-z4vkf_f15d3416-3aa4-4903-bd71-3c12b09008d7/discovery/0.log" Jul 18 02:39:23.045426 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:23.045394 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/0.log" Jul 18 02:39:23.075611 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:23.075564 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/1.log" Jul 18 02:39:23.854464 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:23.854431 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8sh4g_19424578-6287-4c8b-b845-6bbab694b30c/serve-healthcheck-canary/0.log" Jul 18 02:39:24.359312 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:24.359282 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2c2q6_332cc8a8-9c27-48ef-af85-ad8beddf3a04/kube-rbac-proxy/0.log" Jul 18 02:39:24.380299 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:24.380270 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2c2q6_332cc8a8-9c27-48ef-af85-ad8beddf3a04/exporter/0.log" Jul 18 02:39:24.403075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:24.403047 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2c2q6_332cc8a8-9c27-48ef-af85-ad8beddf3a04/extractor/0.log" Jul 18 02:39:26.551666 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:26.551638 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-ft8dd" Jul 18 02:39:27.035637 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:27.035609 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fw2t8_2f3083fc-7f40-437c-bf92-dde79ac08249/server/0.log" Jul 18 02:39:27.151725 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:27.151689 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-5cpp8_27333d8c-0d3d-4799-8d21-53016498b315/manager/0.log" Jul 18 02:39:27.171750 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:27.171724 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-5cpp8_27333d8c-0d3d-4799-8d21-53016498b315/copy-manifests/0.log" Jul 18 02:39:28.839922 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:28.839888 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64d778cd56-g666j_5509cf56-1f5c-4f78-8f42-d3105c04174b/manager/0.log" Jul 18 02:39:29.398180 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:29.398155 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jw55q_45d9b577-58d9-499b-be02-f15aa5819768/istio-proxy/0.log" Jul 18 02:39:29.511528 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:29.511492 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-z4vkf_f15d3416-3aa4-4903-bd71-3c12b09008d7/discovery/0.log" Jul 18 02:39:29.559049 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:29.559016 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/0.log" Jul 18 02:39:29.589679 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:29.589646 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/1.log" Jul 18 02:39:30.821849 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:30.821817 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jw55q_45d9b577-58d9-499b-be02-f15aa5819768/istio-proxy/0.log" Jul 18 02:39:30.940871 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:30.940767 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-z4vkf_f15d3416-3aa4-4903-bd71-3c12b09008d7/discovery/0.log" Jul 18 02:39:30.998340 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:30.998291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/0.log" Jul 18 02:39:31.028552 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:31.028520 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8q85f_c6459608-0ce5-41ce-8eea-b12dcd9f1e53/istio-proxy/1.log" Jul 18 02:39:35.648738 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.648710 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/kube-multus-additional-cni-plugins/0.log" Jul 18 02:39:35.669036 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.669000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/egress-router-binary-copy/0.log" Jul 18 02:39:35.689075 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.689051 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/cni-plugins/0.log" Jul 18 02:39:35.709651 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.709627 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/bond-cni-plugin/0.log" Jul 18 02:39:35.729529 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.729500 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/routeoverride-cni/0.log" Jul 18 02:39:35.751164 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.751139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/whereabouts-cni-bincopy/0.log" Jul 18 02:39:35.775550 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.775520 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w44rx_7f4a7004-fff5-4836-8d76-3dc9d5b1df07/whereabouts-cni/0.log" Jul 18 02:39:35.882061 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.882030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tdpqf_03286a2b-ae6c-4a80-a904-a58d6577a396/kube-multus/0.log" Jul 18 02:39:35.945177 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.945093 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-szhpx_69126e0f-b661-4bcd-82ac-e2bd449a7d14/network-metrics-daemon/0.log" Jul 18 02:39:35.963604 ip-10-0-143-37 kubenswrapper[2558]: I0718 02:39:35.963580 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-szhpx_69126e0f-b661-4bcd-82ac-e2bd449a7d14/kube-rbac-proxy/0.log"