Jul 07 15:10:51.434414 ip-10-0-140-125 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 15:10:51.434423 ip-10-0-140-125 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 15:10:51.434430 ip-10-0-140-125 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 15:10:51.434636 ip-10-0-140-125 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 15:11:01.513783 ip-10-0-140-125 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 15:11:01.513807 ip-10-0-140-125 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eab1692cc1414281bd8a2879b18febf5 -- Jul 07 15:12:59.795134 ip-10-0-140-125 systemd[1]: Starting Kubernetes Kubelet... Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.274699 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282619 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282636 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282640 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282643 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282646 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282650 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282653 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:13:00.314676 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282656 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282661 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282664 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282669 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282672 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282676 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282679 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282685 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282688 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282693 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282698 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282701 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282704 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282708 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282712 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282715 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282718 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282721 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282724 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282731 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:13:00.317281 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282735 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282738 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282741 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282744 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282746 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282750 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282753 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282756 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282759 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282761 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282764 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282770 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282773 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282776 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282779 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282781 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282785 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282787 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282790 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282793 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:13:00.318542 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282796 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282799 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282803 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282809 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282812 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282815 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282818 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282821 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282824 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282827 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282830 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282833 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282836 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282841 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282845 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282850 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282853 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282856 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282859 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282862 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:13:00.320287 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282865 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282868 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282871 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282874 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282876 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282881 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282884 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282888 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282894 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282898 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282916 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282920 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282923 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282926 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282929 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282933 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282936 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282939 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282942 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:13:00.321152 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282945 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282951 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282954 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282957 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282961 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282965 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282968 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282971 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282973 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282976 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282980 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282983 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.282986 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284242 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284253 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284256 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284260 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284263 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284266 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284269 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:13:00.322032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284272 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284275 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284278 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284283 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284286 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284290 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284295 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284298 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284301 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284304 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284307 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284311 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284314 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284317 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284320 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284323 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284326 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284329 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284333 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:13:00.322911 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284340 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284342 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284346 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284354 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284357 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284361 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284364 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284368 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284374 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284377 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284380 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284385 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284389 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284391 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284394 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284397 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284402 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284407 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284411 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:13:00.323746 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284414 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284418 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284420 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284423 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284427 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284433 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284435 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284438 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284441 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284444 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284447 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284451 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284454 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284457 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284461 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284464 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284468 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284473 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284476 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284479 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:13:00.325906 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284482 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284484 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284488 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284490 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284493 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284496 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284499 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284502 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284504 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284507 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284512 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284516 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284519 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284522 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284525 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284527 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284530 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284533 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284538 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:13:00.326761 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284540 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284548 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284554 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284556 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284559 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284562 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284565 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284568 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284570 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284576 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284579 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284582 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284585 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284588 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.284591 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285343 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285350 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285354 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285361 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285364 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:13:00.327608 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285369 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285373 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285376 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285380 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285384 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285388 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285392 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285395 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285399 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285405 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285408 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285411 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285415 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285421 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285424 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285427 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285430 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285433 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285436 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:13:00.328480 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285440 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285443 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285448 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285454 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285457 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285461 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285463 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285466 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285470 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285473 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285476 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285479 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285482 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285485 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285488 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285491 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285497 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285500 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285503 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285506 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:13:00.330196 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285510 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285513 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285516 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285519 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285521 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285525 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285529 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285536 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285538 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285542 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285544 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285548 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285551 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285554 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285559 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285563 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285566 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285570 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285572 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285578 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:13:00.331489 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285581 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285584 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285586 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285589 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285592 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285595 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285598 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285601 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285604 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285607 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285610 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285613 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285619 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285621 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285624 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285627 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285630 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285633 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285636 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285639 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:13:00.333199 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285642 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285645 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285647 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285650 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285656 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285658 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285663 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285666 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285669 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285672 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285675 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285677 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285680 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285683 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:00.285686 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285785 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285793 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285803 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285809 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285814 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285818 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 15:13:00.334055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285822 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285827 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285831 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285835 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285842 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285846 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285850 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285853 2564 flags.go:64] FLAG: --cgroup-root="" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285857 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285860 2564 flags.go:64] FLAG: --client-ca-file="" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285863 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285866 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285870 2564 flags.go:64] FLAG: --cluster-domain="" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285876 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285880 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285883 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285887 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285893 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285896 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285900 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285920 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285926 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285929 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285934 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 15:13:00.335763 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285941 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285945 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285950 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285955 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285959 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285964 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285968 2564 flags.go:64] FLAG: --enable-server="true" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285971 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285976 2564 flags.go:64] FLAG: --event-burst="100" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285980 2564 flags.go:64] FLAG: --event-qps="50" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285984 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285987 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285991 2564 flags.go:64] FLAG: --eviction-hard="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.285995 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286001 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286005 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286008 2564 flags.go:64] FLAG: --eviction-soft="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286012 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286015 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286019 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286022 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286026 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286032 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286035 2564 flags.go:64] FLAG: --feature-gates="" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286039 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 15:13:00.336602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286045 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286048 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286052 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286055 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286059 2564 flags.go:64] FLAG: --help="false" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286062 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-140-125.ec2.internal" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286068 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286072 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286075 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286079 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286087 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286090 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286094 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286097 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286103 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286106 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286114 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286118 2564 flags.go:64] FLAG: --kube-reserved="" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286121 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286125 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286129 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286133 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286137 2564 flags.go:64] FLAG: --lock-file="" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286142 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 15:13:00.338356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286146 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 15:13:00.339246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286149 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 15:13:00.339246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286156 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 15:13:00.339246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:00.286159 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264091 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264128 2564 flags.go:64] FLAG: --logging-format="text" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264137 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264145 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264150 2564 flags.go:64] FLAG: --manifest-url="" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264156 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 07 15:13:01.264165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264168 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264174 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264183 2564 flags.go:64] FLAG: --max-pods="110" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264189 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264195 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264200 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264205 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264211 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264219 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264225 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264250 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264256 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264264 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264271 2564 flags.go:64] FLAG: --pod-cidr="" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264278 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264290 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264296 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264304 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264309 2564 flags.go:64] FLAG: --port="10250" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264316 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264324 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01daa16eb903d5ab1" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264329 2564 flags.go:64] FLAG: --qos-reserved="" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264338 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264345 2564 flags.go:64] FLAG: --register-node="true" Jul 07 15:13:01.264424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264352 2564 flags.go:64] FLAG: --register-with-taints="" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264362 2564 flags.go:64] FLAG: --registry-burst="10" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264369 2564 flags.go:64] FLAG: --registry-qps="5" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264374 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264382 2564 flags.go:64] FLAG: --reserved-memory="" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264390 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264397 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264403 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264410 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264416 2564 flags.go:64] FLAG: --runonce="false" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264423 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264431 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264436 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264442 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264450 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264457 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264464 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264472 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264477 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264485 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264492 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264499 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264505 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264512 2564 flags.go:64] FLAG: --system-cgroups="" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264521 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 15:13:01.265190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264533 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264538 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264544 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264551 2564 flags.go:64] FLAG: --tls-min-version="" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264554 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264558 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264561 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264564 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264568 2564 flags.go:64] FLAG: --v="2" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264573 2564 flags.go:64] FLAG: --version="false" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264579 2564 flags.go:64] FLAG: --vmodule="" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264583 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.264587 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264760 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264764 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264768 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264771 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264775 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264783 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264790 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264794 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264799 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:13:01.265833 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264803 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264807 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264811 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264814 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264817 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264820 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264823 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264826 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264828 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264834 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264837 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264840 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264843 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264846 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264849 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264851 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264854 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264857 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264860 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264863 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:13:01.266442 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264866 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264869 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264872 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264874 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264877 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264880 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264883 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264886 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264889 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264892 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264895 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264897 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264900 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264917 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264920 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264923 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264926 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264929 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264932 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:13:01.266987 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264935 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264938 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264940 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264944 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264947 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264950 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264953 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264956 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264958 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264961 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264964 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264966 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264970 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264973 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264976 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264979 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264981 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264984 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264987 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264990 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:13:01.267493 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264993 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264996 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.264999 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265002 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265004 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265007 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265010 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265013 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265016 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265018 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265022 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265025 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265028 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265031 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265034 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265037 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265040 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265043 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265047 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:13:01.268032 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265051 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265054 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265057 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265060 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265063 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265067 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265071 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265074 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265077 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265080 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265084 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.265089 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:13:01.268530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.265669 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:13:01.273201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.273177 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 15:13:01.273201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.273201 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 15:13:01.273285 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.273223 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 15:13:01.273285 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.273229 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273296 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273303 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273307 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273310 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273315 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273318 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273321 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273324 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273327 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273330 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273333 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273336 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273340 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273344 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:13:01.273342 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273349 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273352 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273355 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273358 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273361 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273364 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273367 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273370 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273373 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273376 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273379 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273381 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273384 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273387 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273391 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273393 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273396 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273399 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273402 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273405 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:13:01.273729 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273407 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273410 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273413 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273416 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273418 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273421 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273424 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273426 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273429 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273432 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273435 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273438 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273441 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273444 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273448 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273451 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273454 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273457 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273460 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273463 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:13:01.274276 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273466 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273469 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273472 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273474 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273477 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273480 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273483 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273485 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273488 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273491 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273494 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273497 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273499 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273502 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273506 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273510 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273513 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273517 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273520 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:13:01.274789 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273523 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273526 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273529 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273531 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273534 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273537 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273541 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273544 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273547 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273550 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273552 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273555 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273558 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273561 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273564 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273567 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273570 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273572 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273577 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273580 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:13:01.275323 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273584 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273586 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273590 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273593 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273595 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273598 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.273604 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273734 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273739 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273742 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273746 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273748 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273751 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273754 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273757 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:13:01.275838 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273760 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273763 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273765 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273769 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273773 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273776 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273779 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273783 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273787 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273791 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273794 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273797 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273801 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273803 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273806 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273809 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273812 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273814 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273817 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:13:01.276267 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273820 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273823 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273825 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273828 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273831 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273833 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273836 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273839 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273841 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273844 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273847 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273850 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273854 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273858 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273861 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273864 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273868 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273872 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273876 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:13:01.276755 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273879 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273882 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273885 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273888 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273891 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273893 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273896 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273899 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273917 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273921 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273924 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273927 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273930 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273933 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273935 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273938 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273941 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273944 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273946 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273949 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:13:01.277297 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273952 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273954 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273957 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273960 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273963 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273965 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273968 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273971 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273974 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273976 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273979 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273985 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273987 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273990 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273993 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.273997 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274001 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274004 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274007 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:13:01.277805 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274010 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274012 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274015 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274018 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274021 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274024 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274026 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274029 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274031 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274034 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274037 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274039 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274042 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:01.274045 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.274050 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:13:01.278318 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.274194 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 15:13:01.278718 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.276469 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 15:13:01.278718 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.277745 2564 server.go:1019] "Starting client certificate rotation" Jul 07 15:13:01.278718 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.277858 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:13:01.278718 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.277902 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:13:01.279960 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.279944 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:13:01.284731 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.284711 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:13:01.291402 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.291384 2564 log.go:25] "Validated CRI v1 runtime API" Jul 07 15:13:01.295734 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.295717 2564 log.go:25] "Validated CRI v1 image API" Jul 07 15:13:01.298397 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.298383 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 15:13:01.301535 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.301512 2564 fs.go:135] Filesystem UUIDs: map[56d8cf61-3d7c-44f7-8f1c-ed1d0122703c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 86b7ae42-07c4-4caa-9db7-28e57d34a26d:/dev/nvme0n1p3] Jul 07 15:13:01.301588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.301535 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 15:13:01.306971 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.306832 2564 manager.go:216] Machine: {Timestamp:2026-07-07 15:13:01.306275688 +0000 UTC m=+1.414670808 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3145609 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287c99c4b51f64681802fc959d5883 SystemUUID:ec287c99-c4b5-1f64-6818-02fc959d5883 BootID:eab1692c-c141-4281-bd8a-2879b18febf5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:8c:10:8f:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:8c:10:8f:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:7f:15:ba:b1:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 15:13:01.306971 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.306958 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 15:13:01.307113 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.307084 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 15:13:01.308710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.308694 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:13:01.309630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.309596 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 15:13:01.309777 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.309634 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 15:13:01.310310 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.310299 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 15:13:01.310349 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.310313 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 15:13:01.310349 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.310321 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:13:01.310999 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.310986 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:13:01.312262 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.312251 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 15:13:01.316648 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316634 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:13:01.317140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316762 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 15:13:01.317140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316792 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 07 15:13:01.317140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316802 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 15:13:01.317140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316821 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 15:13:01.317140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316832 2564 kubelet.go:398] "Adding apiserver pod source" Jul 07 15:13:01.317140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.316842 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 15:13:01.317357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.317238 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:13:01.317357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.317261 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:13:01.319102 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.319082 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 15:13:01.320867 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.320853 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 15:13:01.320928 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.320886 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 15:13:01.322072 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322054 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322077 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322087 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322096 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322107 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322116 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322128 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322136 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322147 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 15:13:01.322172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322156 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 15:13:01.322451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322180 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 15:13:01.322451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322189 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 15:13:01.322860 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322849 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 15:13:01.322931 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.322863 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 15:13:01.326441 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.326418 2564 server.go:1268] "Started kubelet" Jul 07 15:13:01.326560 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.326531 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 15:13:01.326665 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.326528 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 15:13:01.326665 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.326611 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 15:13:01.327377 ip-10-0-140-125 systemd[1]: Started Kubernetes Kubelet. Jul 07 15:13:01.328524 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.328475 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 15:13:01.328745 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.328720 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 07 15:13:01.330023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.330004 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 15:13:01.330023 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.330008 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 15:13:01.330227 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.330209 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 15:13:01.333326 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.333307 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 15:13:01.334711 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.334696 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 15:13:01.334711 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.334708 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 15:13:01.334824 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.334778 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.335341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.335322 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 15:13:01.337337 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.337221 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 15:13:01.337337 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.337336 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 15:13:01.337535 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.337521 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 07 15:13:01.337614 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.337536 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 07 15:13:01.337614 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.335144 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaad82ee907 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.326387463 +0000 UTC m=+1.434782583,LastTimestamp:2026-07-07 15:13:01.326387463 +0000 UTC m=+1.434782583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.338139 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338121 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 15:13:01.338139 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338141 2564 factory.go:55] Registering systemd factory Jul 07 15:13:01.338286 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338159 2564 factory.go:223] Registration of the systemd container factory successfully Jul 07 15:13:01.338846 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338817 2564 factory.go:153] Registering CRI-O factory Jul 07 15:13:01.338930 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338861 2564 factory.go:223] Registration of the crio container factory successfully Jul 07 15:13:01.338930 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338888 2564 factory.go:103] Registering Raw factory Jul 07 15:13:01.338930 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.338912 2564 manager.go:1196] Started watching for new ooms in manager Jul 07 15:13:01.339487 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.339472 2564 manager.go:349] Starting recovery of all containers Jul 07 15:13:01.346230 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.346034 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 15:13:01.346394 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.346368 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 15:13:01.351349 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.351331 2564 manager.go:354] Recovery completed Jul 07 15:13:01.356091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.356077 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.359113 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359088 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.359180 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359127 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.359180 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359138 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.359669 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359653 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 15:13:01.359669 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359666 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 15:13:01.359771 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359682 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:13:01.359771 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.359660 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.360416 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.360400 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.360458 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.360431 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.360458 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.360445 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.361798 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.361731 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaada223f31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-125.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.359111985 +0000 UTC m=+1.467507107,LastTimestamp:2026-07-07 15:13:01.359111985 +0000 UTC m=+1.467507107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.362243 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.362231 2564 policy_none.go:49] "None policy: Start" Jul 07 15:13:01.362311 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.362246 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 15:13:01.362311 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.362259 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 15:13:01.364488 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.364477 2564 policy_none.go:47] "Start" Jul 07 15:13:01.370925 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.370827 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaada228d38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-125.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.35913196 +0000 UTC m=+1.467527080,LastTimestamp:2026-07-07 15:13:01.35913196 +0000 UTC m=+1.467527080,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.376963 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.376878 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaada22b8f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-125.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.359143161 +0000 UTC m=+1.467538281,LastTimestamp:2026-07-07 15:13:01.359143161 +0000 UTC m=+1.467538281,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.380498 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.380434 2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-125.ec2.internal.18c00aaada223f31\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaada223f31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-125.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.359111985 +0000 UTC m=+1.467507107,LastTimestamp:2026-07-07 15:13:01.360415502 +0000 UTC m=+1.468810621,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.385562 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.385542 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lx2pg" Jul 07 15:13:01.392256 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.392190 2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-125.ec2.internal.18c00aaada228d38\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaada228d38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-125.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.35913196 +0000 UTC m=+1.467527080,LastTimestamp:2026-07-07 15:13:01.360439169 +0000 UTC m=+1.468834289,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.398106 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.398088 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lx2pg" Jul 07 15:13:01.399525 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.399455 2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-125.ec2.internal.18c00aaada22b8f9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18c00aaada22b8f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-125.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-07 15:13:01.359143161 +0000 UTC m=+1.467538281,LastTimestamp:2026-07-07 15:13:01.360448936 +0000 UTC m=+1.468844056,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 07 15:13:01.400532 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.400516 2564 manager.go:337] "Starting Device Plugin manager" Jul 07 15:13:01.400614 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.400552 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 15:13:01.400614 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.400562 2564 server.go:87] "Starting device plugin registration server" Jul 07 15:13:01.400851 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.400834 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 15:13:01.400955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.400851 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 15:13:01.400955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.400929 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 15:13:01.401068 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.401012 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 15:13:01.401068 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.401022 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 15:13:01.401671 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.401653 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 15:13:01.401749 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.401697 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.505454 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.505410 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.507095 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.506676 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.507095 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.506704 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.507095 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.506714 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.507095 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.506742 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.514122 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.514085 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 15:13:01.515539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.515478 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 15:13:01.515539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.515518 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 15:13:01.515539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.515540 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 15:13:01.515710 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.515574 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 15:13:01.517410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.517391 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.517518 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.517413 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-125.ec2.internal\": node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.518456 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.518435 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:13:01.614191 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.614155 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.616262 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.616226 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal"] Jul 07 15:13:01.616378 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.616299 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.617383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.617367 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.617461 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.617396 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.617461 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.617406 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.619191 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619177 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.619325 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.619378 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619340 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.619963 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619943 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.620035 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619973 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.620035 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619984 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.620035 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.619943 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.620126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.620063 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.620126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.620078 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.621875 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.621861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.621947 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.621888 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:01.622603 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.622576 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:01.622699 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.622607 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:01.622699 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.622624 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:01.639953 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.639930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.640045 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.639964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.640045 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.639988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d7c4a409d43abc3672000c2f9d10d0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-125.ec2.internal\" (UID: \"73d7c4a409d43abc3672000c2f9d10d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.645791 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.645774 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-125.ec2.internal\" not found" node="ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.650544 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.650525 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-125.ec2.internal\" not found" node="ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.714963 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.714934 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.740442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.740409 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.740442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.740422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.740630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.740478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.740630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.740496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d7c4a409d43abc3672000c2f9d10d0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-125.ec2.internal\" (UID: \"73d7c4a409d43abc3672000c2f9d10d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.740630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.740550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.740630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.740605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d7c4a409d43abc3672000c2f9d10d0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-125.ec2.internal\" (UID: \"73d7c4a409d43abc3672000c2f9d10d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.817579 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.817475 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.923094 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:01.923042 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:01.949060 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.949025 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:01.953861 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:01.953628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 07 15:13:02.027131 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.027093 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.134156 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.134056 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.238033 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.237989 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.278370 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.278325 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 15:13:02.278521 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.278502 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:13:02.338620 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.338587 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.401267 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.401157 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:08:01 +0000 UTC" deadline="2027-12-15 19:31:06.191706421 +0000 UTC" Jul 07 15:13:02.401267 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.401204 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12628h18m3.790506638s" Jul 07 15:13:02.439528 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.439479 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.490093 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.490059 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:13:02.491942 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.491923 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:13:02.492055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.491964 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:13:02.492055 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.491982 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:13:02.540067 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.540036 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.640754 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.640726 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.646950 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:02.646908 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d7c4a409d43abc3672000c2f9d10d0.slice/crio-851288799ce359448ae4c33f263e5428a13e57bae5e6fdaf47e95b6ca0c074c9 WatchSource:0}: Error finding container 851288799ce359448ae4c33f263e5428a13e57bae5e6fdaf47e95b6ca0c074c9: Status 404 returned error can't find the container with id 851288799ce359448ae4c33f263e5428a13e57bae5e6fdaf47e95b6ca0c074c9 Jul 07 15:13:02.651930 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.651854 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:13:02.657922 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:02.657896 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cc2de8cb98e91a5f3c674fe90aba6e.slice/crio-ed3e532e62fbd87ff9eb09d4a81ca5ca22722e8ba95fb7df9d73962f7b8b5aa2 WatchSource:0}: Error finding container ed3e532e62fbd87ff9eb09d4a81ca5ca22722e8ba95fb7df9d73962f7b8b5aa2: Status 404 returned error can't find the container with id ed3e532e62fbd87ff9eb09d4a81ca5ca22722e8ba95fb7df9d73962f7b8b5aa2 Jul 07 15:13:02.741616 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:02.741581 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 07 15:13:02.763741 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.763718 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:13:02.797240 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.797213 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:13:02.820144 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.820116 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:13:02.835975 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.835945 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 07 15:13:02.846472 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.846436 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:13:02.847286 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.847271 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 07 15:13:02.863981 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:02.863955 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:13:03.203765 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.203731 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:13:03.320104 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.320047 2564 apiserver.go:52] "Watching apiserver" Jul 07 15:13:03.329243 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.329214 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 15:13:03.329570 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.329548 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-jslxj","openshift-ovn-kubernetes/ovnkube-node-72z5s","kube-system/global-pull-secret-syncer-kslrs","kube-system/konnectivity-agent-7v999","kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal","openshift-multus/multus-gxzgh","openshift-network-operator/iptables-alerter-4pqrz","openshift-cluster-node-tuning-operator/tuned-c486m","openshift-dns/node-resolver-gg2qn","openshift-image-registry/node-ca-wsnkl","openshift-multus/multus-additional-cni-plugins-9xmj5","openshift-multus/network-metrics-daemon-5vhcw"] Jul 07 15:13:03.332525 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.332506 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.334719 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.334696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.335001 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.334982 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 15:13:03.335400 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.335379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 15:13:03.335573 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.335550 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zdc2v\"" Jul 07 15:13:03.335649 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.335555 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.335649 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.335590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.337488 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.337466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.337888 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.337868 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 15:13:03.338010 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.337999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.338080 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.338043 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9j98h\"" Jul 07 15:13:03.338080 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.338072 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.339759 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.339740 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.340318 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.340157 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n9n4h\"" Jul 07 15:13:03.340630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.340614 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.340710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.340656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.342023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.342003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.342115 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.342070 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:03.342331 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.342318 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 15:13:03.343235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.343221 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 15:13:03.344511 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.344492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.345861 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.345844 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hb9mw\"" Jul 07 15:13:03.346761 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.346741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.347091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-etc-selinux\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.347166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysconfig\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysctl-conf\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-systemd\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d63fd4d5-a176-458a-8da3-50eb960edd95-host\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d63fd4d5-a176-458a-8da3-50eb960edd95-serviceca\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-sys\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-host\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3248264a-d99e-49f5-90d2-681ffcd272ce-tmp\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2q46\" (UniqueName: \"kubernetes.io/projected/3248264a-d99e-49f5-90d2-681ffcd272ce-kube-api-access-z2q46\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l4pn\" (UniqueName: \"kubernetes.io/projected/2378cf83-8919-41a6-a66b-9f72cbda1c31-kube-api-access-2l4pn\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.347341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347326 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347372 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347372 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczv8\" (UniqueName: \"kubernetes.io/projected/d63fd4d5-a176-458a-8da3-50eb960edd95-kube-api-access-vczv8\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347454 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-socket-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-registration-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-kubernetes\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-lib-modules\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-modprobe-d\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysctl-d\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-run\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-var-lib-kubelet\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 15:13:03.347710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-tuned\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.348221 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-sys-fs\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.348221 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347725 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pmjnd\"" Jul 07 15:13:03.348221 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.347766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-device-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.349192 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.349173 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:03.349299 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.349279 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:03.349667 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.349649 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:13:03.349756 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.349656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.349756 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.349709 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pgtx2\"" Jul 07 15:13:03.349866 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.349766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 15:13:03.350009 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.349991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.351622 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.351606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.354483 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.354319 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5dg7c\"" Jul 07 15:13:03.354585 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.354559 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.354871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.354837 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.355508 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.355042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.358589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.358570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.359232 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.359216 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 15:13:03.359314 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.359280 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 15:13:03.359450 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.359432 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7t64q\"" Jul 07 15:13:03.359520 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.359459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 15:13:03.359520 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.359510 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 15:13:03.359627 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.359533 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 15:13:03.360447 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.360414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 15:13:03.360973 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.360958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:03.361030 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.361015 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:03.361251 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.361235 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 15:13:03.365217 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.365197 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 15:13:03.365453 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.365434 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xsh26\"" Jul 07 15:13:03.384877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.384845 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nnfv9" Jul 07 15:13:03.392811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.392793 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nnfv9" Jul 07 15:13:03.436562 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.436527 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 15:13:03.448856 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-socket-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.448856 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-var-lib-kubelet\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxhj\" (UniqueName: \"kubernetes.io/projected/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-kube-api-access-9hxhj\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-os-release\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f966d03-c5f8-4060-9710-9e395755005b-hosts-file\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-ovn\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.448996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-node-log\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-etc-selinux\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.449092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-systemd\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0548311-bdd8-42f1-ace0-31df79383ef3-konnectivity-ca\") pod \"konnectivity-agent-7v999\" (UID: \"c0548311-bdd8-42f1-ace0-31df79383ef3\") " pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-os-release\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-slash\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-cni-bin\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovn-node-metrics-cert\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d63fd4d5-a176-458a-8da3-50eb960edd95-host\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-daemon-config\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-systemd\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.449451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-etc-selinux\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-socket-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d63fd4d5-a176-458a-8da3-50eb960edd95-host\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-multus-certs\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-var-lib-kubelet\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-run-netns\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-env-overrides\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczv8\" (UniqueName: \"kubernetes.io/projected/d63fd4d5-a176-458a-8da3-50eb960edd95-kube-api-access-vczv8\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-lib-modules\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/454a8fa9-bdf4-40b9-8595-1915c5b459b8-iptables-alerter-script\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-netns\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-log-socket\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-modprobe-d\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449910 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-lib-modules\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-run\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.450031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.449965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-cni-binary-copy\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-cni-bin\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-systemd-units\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-modprobe-d\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-etc-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-run\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovnkube-config\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrtw8\" (UniqueName: \"kubernetes.io/projected/884e4b7a-1ab6-4b17-b08d-c77e3d750636-kube-api-access-nrtw8\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-socket-dir-parent\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3248264a-d99e-49f5-90d2-681ffcd272ce-tmp\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2q46\" (UniqueName: \"kubernetes.io/projected/3248264a-d99e-49f5-90d2-681ffcd272ce-kube-api-access-z2q46\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-device-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysctl-conf\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-system-cni-dir\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slcqx\" (UniqueName: \"kubernetes.io/projected/8f966d03-c5f8-4060-9710-9e395755005b-kube-api-access-slcqx\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d63fd4d5-a176-458a-8da3-50eb960edd95-serviceca\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.451052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-systemd\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49dqk\" (UniqueName: \"kubernetes.io/projected/874b35c8-99a7-4d48-b8da-8f4059630b51-kube-api-access-49dqk\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l4pn\" (UniqueName: \"kubernetes.io/projected/2378cf83-8919-41a6-a66b-9f72cbda1c31-kube-api-access-2l4pn\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-registration-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-kubernetes\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysctl-d\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31a1df73-0abf-416a-bbff-6a72f6419abc-kubelet-config\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv42w\" (UniqueName: \"kubernetes.io/projected/454a8fa9-bdf4-40b9-8595-1915c5b459b8-kube-api-access-zv42w\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-cni-multus\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-conf-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-var-lib-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovnkube-script-lib\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-sys\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysconfig\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-cnibin\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.450996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f966d03-c5f8-4060-9710-9e395755005b-tmp-dir\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-kubelet\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-host\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wjw\" (UniqueName: \"kubernetes.io/projected/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-kube-api-access-k4wjw\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454a8fa9-bdf4-40b9-8595-1915c5b459b8-host-slash\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cnibin\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-system-cni-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-kubelet\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-etc-kubernetes\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-tuned\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0548311-bdd8-42f1-ace0-31df79383ef3-agent-certs\") pod \"konnectivity-agent-7v999\" (UID: \"c0548311-bdd8-42f1-ace0-31df79383ef3\") " pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-cni-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-k8s-cni-cncf-io\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-hostroot\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-sys-fs\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.452941 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-run-ovn-kubernetes\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31a1df73-0abf-416a-bbff-6a72f6419abc-dbus\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.451589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-cni-netd\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452008 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysconfig\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-sys\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452468 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-kubernetes\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysctl-d\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-sys-fs\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452586 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-host\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452746 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-device-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d63fd4d5-a176-458a-8da3-50eb960edd95-serviceca\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-sysctl-conf\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.453986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.452978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2378cf83-8919-41a6-a66b-9f72cbda1c31-registration-dir\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.457614 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.457575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3248264a-d99e-49f5-90d2-681ffcd272ce-etc-tuned\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.457751 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.457633 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3248264a-d99e-49f5-90d2-681ffcd272ce-tmp\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.466162 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.466138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2q46\" (UniqueName: \"kubernetes.io/projected/3248264a-d99e-49f5-90d2-681ffcd272ce-kube-api-access-z2q46\") pod \"tuned-c486m\" (UID: \"3248264a-d99e-49f5-90d2-681ffcd272ce\") " pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.466295 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.466146 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczv8\" (UniqueName: \"kubernetes.io/projected/d63fd4d5-a176-458a-8da3-50eb960edd95-kube-api-access-vczv8\") pod \"node-ca-wsnkl\" (UID: \"d63fd4d5-a176-458a-8da3-50eb960edd95\") " pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.468269 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.468245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l4pn\" (UniqueName: \"kubernetes.io/projected/2378cf83-8919-41a6-a66b-9f72cbda1c31-kube-api-access-2l4pn\") pod \"aws-ebs-csi-driver-node-hv5hb\" (UID: \"2378cf83-8919-41a6-a66b-9f72cbda1c31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.525748 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.525633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" event={"ID":"07cc2de8cb98e91a5f3c674fe90aba6e","Type":"ContainerStarted","Data":"ed3e532e62fbd87ff9eb09d4a81ca5ca22722e8ba95fb7df9d73962f7b8b5aa2"} Jul 07 15:13:03.527357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.527323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" event={"ID":"73d7c4a409d43abc3672000c2f9d10d0","Type":"ContainerStarted","Data":"851288799ce359448ae4c33f263e5428a13e57bae5e6fdaf47e95b6ca0c074c9"} Jul 07 15:13:03.552758 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxhj\" (UniqueName: \"kubernetes.io/projected/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-kube-api-access-9hxhj\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.552923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-os-release\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.552923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f966d03-c5f8-4060-9710-9e395755005b-hosts-file\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.552923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-ovn\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.552923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-node-log\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.552923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0548311-bdd8-42f1-ace0-31df79383ef3-konnectivity-ca\") pod \"konnectivity-agent-7v999\" (UID: \"c0548311-bdd8-42f1-ace0-31df79383ef3\") " pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-os-release\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.552978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-slash\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-cni-bin\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovn-node-metrics-cert\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-daemon-config\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-multus-certs\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-run-netns\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-env-overrides\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/454a8fa9-bdf4-40b9-8595-1915c5b459b8-iptables-alerter-script\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-netns\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-log-socket\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-cni-binary-copy\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-cni-bin\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-systemd-units\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-etc-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovnkube-config\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrtw8\" (UniqueName: \"kubernetes.io/projected/884e4b7a-1ab6-4b17-b08d-c77e3d750636-kube-api-access-nrtw8\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-socket-dir-parent\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-system-cni-dir\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slcqx\" (UniqueName: \"kubernetes.io/projected/8f966d03-c5f8-4060-9710-9e395755005b-kube-api-access-slcqx\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-systemd\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49dqk\" (UniqueName: \"kubernetes.io/projected/874b35c8-99a7-4d48-b8da-8f4059630b51-kube-api-access-49dqk\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:03.553807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31a1df73-0abf-416a-bbff-6a72f6419abc-kubelet-config\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv42w\" (UniqueName: \"kubernetes.io/projected/454a8fa9-bdf4-40b9-8595-1915c5b459b8-kube-api-access-zv42w\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553691 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0548311-bdd8-42f1-ace0-31df79383ef3-konnectivity-ca\") pod \"konnectivity-agent-7v999\" (UID: \"c0548311-bdd8-42f1-ace0-31df79383ef3\") " pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-cni-multus\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-conf-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-var-lib-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovnkube-script-lib\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553848 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f966d03-c5f8-4060-9710-9e395755005b-hosts-file\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-cnibin\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f966d03-c5f8-4060-9710-9e395755005b-tmp-dir\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553904 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-ovn\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-kubelet\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553970 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-node-log\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.553990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wjw\" (UniqueName: \"kubernetes.io/projected/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-kube-api-access-k4wjw\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454a8fa9-bdf4-40b9-8595-1915c5b459b8-host-slash\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.554730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cnibin\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-system-cni-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-kubelet\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-etc-kubernetes\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0548311-bdd8-42f1-ace0-31df79383ef3-agent-certs\") pod \"konnectivity-agent-7v999\" (UID: \"c0548311-bdd8-42f1-ace0-31df79383ef3\") " pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-cni-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-k8s-cni-cncf-io\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554341 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-os-release\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-k8s-cni-cncf-io\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-slash\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-cni-bin\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovnkube-config\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554637 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-socket-dir-parent\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-systemd-units\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554693 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-system-cni-dir\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.555657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554693 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-env-overrides\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554738 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-cni-bin\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-cnibin\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554844 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-log-socket\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-hostroot\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-run-ovn-kubernetes\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.554979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31a1df73-0abf-416a-bbff-6a72f6419abc-dbus\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-cni-netd\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-cni-netd\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-cni-binary-copy\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555210 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-etc-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555222 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f966d03-c5f8-4060-9710-9e395755005b-tmp-dir\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-run-ovn-kubernetes\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.555269 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555278 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-kubelet\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-hostroot\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/454a8fa9-bdf4-40b9-8595-1915c5b459b8-iptables-alerter-script\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.556582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-kubelet\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.555368 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:13:04.055323809 +0000 UTC m=+4.163718947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454a8fa9-bdf4-40b9-8595-1915c5b459b8-host-slash\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-host-run-netns\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-netns\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-system-cni-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555579 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-os-release\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-run-systemd\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555958 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-etc-kubernetes\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.555992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-daemon-config\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-run-multus-certs\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556019 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-conf-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556061 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/884e4b7a-1ab6-4b17-b08d-c77e3d750636-var-lib-openvswitch\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.556116 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:03.557506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-host-var-lib-cni-multus\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.556182 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:04.056149989 +0000 UTC m=+4.164545104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31a1df73-0abf-416a-bbff-6a72f6419abc-kubelet-config\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556194 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-multus-cni-dir\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cnibin\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovnkube-script-lib\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31a1df73-0abf-416a-bbff-6a72f6419abc-dbus\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.556685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.558426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.557279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/884e4b7a-1ab6-4b17-b08d-c77e3d750636-ovn-node-metrics-cert\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.559037 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.559013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0548311-bdd8-42f1-ace0-31df79383ef3-agent-certs\") pod \"konnectivity-agent-7v999\" (UID: \"c0548311-bdd8-42f1-ace0-31df79383ef3\") " pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.561986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.561933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxhj\" (UniqueName: \"kubernetes.io/projected/d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce-kube-api-access-9hxhj\") pod \"multus-additional-cni-plugins-9xmj5\" (UID: \"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce\") " pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.565587 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.565566 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:03.565689 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.565595 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:03.565689 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.565608 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:03.565689 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:03.565662 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:04.065645716 +0000 UTC m=+4.174040841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:03.567465 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.567439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrtw8\" (UniqueName: \"kubernetes.io/projected/884e4b7a-1ab6-4b17-b08d-c77e3d750636-kube-api-access-nrtw8\") pod \"ovnkube-node-72z5s\" (UID: \"884e4b7a-1ab6-4b17-b08d-c77e3d750636\") " pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.570936 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.570501 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv42w\" (UniqueName: \"kubernetes.io/projected/454a8fa9-bdf4-40b9-8595-1915c5b459b8-kube-api-access-zv42w\") pod \"iptables-alerter-4pqrz\" (UID: \"454a8fa9-bdf4-40b9-8595-1915c5b459b8\") " pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.570936 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.570874 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49dqk\" (UniqueName: \"kubernetes.io/projected/874b35c8-99a7-4d48-b8da-8f4059630b51-kube-api-access-49dqk\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:03.571508 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.571482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wjw\" (UniqueName: \"kubernetes.io/projected/97b55eb8-b533-42cf-b9b5-8472e4c3ba9f-kube-api-access-k4wjw\") pod \"multus-gxzgh\" (UID: \"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f\") " pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.571923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.571882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slcqx\" (UniqueName: \"kubernetes.io/projected/8f966d03-c5f8-4060-9710-9e395755005b-kube-api-access-slcqx\") pod \"node-resolver-gg2qn\" (UID: \"8f966d03-c5f8-4060-9710-9e395755005b\") " pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.642405 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.642371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" Jul 07 15:13:03.648906 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.648883 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsnkl" Jul 07 15:13:03.657157 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.657127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2378cf83_8919_41a6_a66b_9f72cbda1c31.slice/crio-9bec5bf11436bab9940dc2b9db68377c9bf6c10e7c80a9711c3ed0861496b2b8 WatchSource:0}: Error finding container 9bec5bf11436bab9940dc2b9db68377c9bf6c10e7c80a9711c3ed0861496b2b8: Status 404 returned error can't find the container with id 9bec5bf11436bab9940dc2b9db68377c9bf6c10e7c80a9711c3ed0861496b2b8 Jul 07 15:13:03.657882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.657858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c486m" Jul 07 15:13:03.659537 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.659509 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63fd4d5_a176_458a_8da3_50eb960edd95.slice/crio-3b8b9813ba4a634f9711ce905375262f45d51d284791888bd157c0441585a733 WatchSource:0}: Error finding container 3b8b9813ba4a634f9711ce905375262f45d51d284791888bd157c0441585a733: Status 404 returned error can't find the container with id 3b8b9813ba4a634f9711ce905375262f45d51d284791888bd157c0441585a733 Jul 07 15:13:03.663244 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.663223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:03.669766 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.669728 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3248264a_d99e_49f5_90d2_681ffcd272ce.slice/crio-0d363c91320cecdfe14402efe249293aae1f97bf937fa98d7692cd3cbd10132f WatchSource:0}: Error finding container 0d363c91320cecdfe14402efe249293aae1f97bf937fa98d7692cd3cbd10132f: Status 404 returned error can't find the container with id 0d363c91320cecdfe14402efe249293aae1f97bf937fa98d7692cd3cbd10132f Jul 07 15:13:03.669892 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.669869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxzgh" Jul 07 15:13:03.675398 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.675365 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0548311_bdd8_42f1_ace0_31df79383ef3.slice/crio-eb217a6483eb776417391073e8ef333a0b047d768c6f07631d8296ded34c3104 WatchSource:0}: Error finding container eb217a6483eb776417391073e8ef333a0b047d768c6f07631d8296ded34c3104: Status 404 returned error can't find the container with id eb217a6483eb776417391073e8ef333a0b047d768c6f07631d8296ded34c3104 Jul 07 15:13:03.676466 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.676449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4pqrz" Jul 07 15:13:03.680782 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.680761 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b55eb8_b533_42cf_b9b5_8472e4c3ba9f.slice/crio-7e7b5625aef998c65b0dea96d401aa17145be3559b5bc697abce9ba057d2bdff WatchSource:0}: Error finding container 7e7b5625aef998c65b0dea96d401aa17145be3559b5bc697abce9ba057d2bdff: Status 404 returned error can't find the container with id 7e7b5625aef998c65b0dea96d401aa17145be3559b5bc697abce9ba057d2bdff Jul 07 15:13:03.682450 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.682419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gg2qn" Jul 07 15:13:03.687859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.687642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:03.693959 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:03.693788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" Jul 07 15:13:03.696428 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.696391 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f966d03_c5f8_4060_9710_9e395755005b.slice/crio-c488c80c130c863daecbd59840b489856ff722dbfbbd74e81459a6f6589233d9 WatchSource:0}: Error finding container c488c80c130c863daecbd59840b489856ff722dbfbbd74e81459a6f6589233d9: Status 404 returned error can't find the container with id c488c80c130c863daecbd59840b489856ff722dbfbbd74e81459a6f6589233d9 Jul 07 15:13:03.701193 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.701147 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884e4b7a_1ab6_4b17_b08d_c77e3d750636.slice/crio-98f2506a3504f209ff1cfa1b144409aad7c12deb4469a2e4d366da07f1f514ed WatchSource:0}: Error finding container 98f2506a3504f209ff1cfa1b144409aad7c12deb4469a2e4d366da07f1f514ed: Status 404 returned error can't find the container with id 98f2506a3504f209ff1cfa1b144409aad7c12deb4469a2e4d366da07f1f514ed Jul 07 15:13:03.707270 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:03.707208 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b1efc6_b834_4f7b_9ea0_d992b52ab1ce.slice/crio-e89b7212d08bdc551610ba639b00bc1396b130b91189823469b474284ca8e9a6 WatchSource:0}: Error finding container e89b7212d08bdc551610ba639b00bc1396b130b91189823469b474284ca8e9a6: Status 404 returned error can't find the container with id e89b7212d08bdc551610ba639b00bc1396b130b91189823469b474284ca8e9a6 Jul 07 15:13:04.059585 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.059497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:04.059585 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.059564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:04.059767 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.059672 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:04.059767 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.059741 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:05.05972327 +0000 UTC m=+5.168118380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:04.059915 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.059674 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:04.059915 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.059815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:13:05.059802273 +0000 UTC m=+5.168197394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:04.160752 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.160713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:04.160947 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.160894 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:04.160947 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.160917 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:04.160947 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.160932 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:04.161169 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.161000 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:05.160979824 +0000 UTC m=+5.269374933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:04.396791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.396675 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:08:03 +0000 UTC" deadline="2028-02-19 13:17:53.284207442 +0000 UTC" Jul 07 15:13:04.396791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.396730 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14206h4m48.887482289s" Jul 07 15:13:04.516784 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.516747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:04.516989 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:04.516937 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:04.531612 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.531515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"98f2506a3504f209ff1cfa1b144409aad7c12deb4469a2e4d366da07f1f514ed"} Jul 07 15:13:04.532803 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.532751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gg2qn" event={"ID":"8f966d03-c5f8-4060-9710-9e395755005b","Type":"ContainerStarted","Data":"c488c80c130c863daecbd59840b489856ff722dbfbbd74e81459a6f6589233d9"} Jul 07 15:13:04.535223 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.534866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4pqrz" event={"ID":"454a8fa9-bdf4-40b9-8595-1915c5b459b8","Type":"ContainerStarted","Data":"ff07008850a3a8a79f28988c6af33b3f5f5f38f58d7510cf5ee209807f916a71"} Jul 07 15:13:04.536543 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.536499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxzgh" event={"ID":"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f","Type":"ContainerStarted","Data":"7e7b5625aef998c65b0dea96d401aa17145be3559b5bc697abce9ba057d2bdff"} Jul 07 15:13:04.538811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.538704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7v999" event={"ID":"c0548311-bdd8-42f1-ace0-31df79383ef3","Type":"ContainerStarted","Data":"eb217a6483eb776417391073e8ef333a0b047d768c6f07631d8296ded34c3104"} Jul 07 15:13:04.541391 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.541354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" event={"ID":"2378cf83-8919-41a6-a66b-9f72cbda1c31","Type":"ContainerStarted","Data":"9bec5bf11436bab9940dc2b9db68377c9bf6c10e7c80a9711c3ed0861496b2b8"} Jul 07 15:13:04.544980 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.544914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerStarted","Data":"e89b7212d08bdc551610ba639b00bc1396b130b91189823469b474284ca8e9a6"} Jul 07 15:13:04.549272 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.548643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c486m" event={"ID":"3248264a-d99e-49f5-90d2-681ffcd272ce","Type":"ContainerStarted","Data":"0d363c91320cecdfe14402efe249293aae1f97bf937fa98d7692cd3cbd10132f"} Jul 07 15:13:04.550518 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:04.550466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsnkl" event={"ID":"d63fd4d5-a176-458a-8da3-50eb960edd95","Type":"ContainerStarted","Data":"3b8b9813ba4a634f9711ce905375262f45d51d284791888bd157c0441585a733"} Jul 07 15:13:05.069351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.069312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:05.069549 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.069385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:05.069549 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.069532 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:05.069669 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.069598 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:13:07.069577339 +0000 UTC m=+7.177972466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:05.070121 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.070091 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:05.070252 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.070146 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:07.070130927 +0000 UTC m=+7.178526039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:05.170652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.170586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:05.170813 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.170796 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:05.170855 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.170818 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:05.170855 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.170832 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:05.170951 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.170919 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:07.170899217 +0000 UTC m=+7.279294338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:05.397094 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.396979 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:08:03 +0000 UTC" deadline="2028-02-02 02:22:27.383825501 +0000 UTC" Jul 07 15:13:05.397094 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.397039 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13787h9m21.986790744s" Jul 07 15:13:05.517545 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.517029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:05.517545 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.517158 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:05.518142 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:05.517932 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:05.518142 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:05.518050 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:06.516308 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:06.516129 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:06.516308 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:06.516275 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:07.087776 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:07.087740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:07.087991 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:07.087814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:07.087991 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.087942 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:07.088117 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.088016 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:11.087999259 +0000 UTC m=+11.196394382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:07.088117 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.087947 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:07.088117 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.088110 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:13:11.088093356 +0000 UTC m=+11.196488464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:07.188923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:07.188872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:07.189118 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.189069 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:07.189118 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.189096 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:07.189118 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.189112 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:07.189290 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.189190 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:11.189170014 +0000 UTC m=+11.297565124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:07.517062 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:07.516933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:07.517500 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.517147 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:07.517561 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:07.516976 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:07.517676 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:07.517649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:08.516565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:08.516527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:08.516762 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:08.516700 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:09.516701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:09.516154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:09.516701 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:09.516303 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:09.516701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:09.516154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:09.517249 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:09.516748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:10.516328 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:10.516289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:10.516505 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:10.516434 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:11.121157 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:11.120579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:11.121157 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:11.120651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:11.121157 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.120764 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:11.121157 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.120819 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:13:19.120801208 +0000 UTC m=+19.229196316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:11.121157 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.121032 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:11.121157 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.121086 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:19.121072246 +0000 UTC m=+19.229467361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:11.221269 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:11.221230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:11.221450 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.221396 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:11.221450 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.221417 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:11.221450 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.221430 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:11.221608 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.221485 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:19.221466878 +0000 UTC m=+19.329861996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:11.517704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:11.517565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:11.517704 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.517684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:11.517945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:11.517746 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:11.517945 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:11.517891 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:12.516742 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:12.516706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:12.517200 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:12.516883 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:13.515814 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:13.515779 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:13.516016 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:13.515939 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:13.516016 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:13.515969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:13.516111 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:13.516062 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:14.516373 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:14.516336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:14.516857 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:14.516482 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:14.577276 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:14.577189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c486m" event={"ID":"3248264a-d99e-49f5-90d2-681ffcd272ce","Type":"ContainerStarted","Data":"ba0b666c1e192b4be1939487ddd3fea0824a3a0531364383804bccfc08ecef33"} Jul 07 15:13:14.579155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:14.579125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" event={"ID":"73d7c4a409d43abc3672000c2f9d10d0","Type":"ContainerStarted","Data":"2043304d6f7d111cd9412ca0a47838698b86d4386f5b816144687a2c457765ef"} Jul 07 15:13:14.594948 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:14.594887 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c486m" podStartSLOduration=1.954616022 podStartE2EDuration="12.594869594s" totalImagesPullingTime="10.640253572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:14.594663134 +0000 UTC m=+14.703058262" watchObservedRunningTime="2026-07-07 15:13:14.594869594 +0000 UTC m=+14.703264721" Jul 07 15:13:14.608557 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:14.608509 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" podStartSLOduration=11.608485087 podStartE2EDuration="11.608485087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:14.608170052 +0000 UTC m=+14.716565179" watchObservedRunningTime="2026-07-07 15:13:14.608485087 +0000 UTC m=+14.716880214" Jul 07 15:13:15.516715 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:15.516076 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:15.516715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:15.516211 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:15.516715 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:15.516309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:15.516715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:15.516428 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:15.582811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:15.582774 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4pqrz" event={"ID":"454a8fa9-bdf4-40b9-8595-1915c5b459b8","Type":"ContainerStarted","Data":"975dc859158a92859967f0f583e163ab0ba9a129dc46bbf9d6c6094257aa1a8e"} Jul 07 15:13:16.515972 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.515886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:16.516129 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:16.516023 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:16.586077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.586037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7v999" event={"ID":"c0548311-bdd8-42f1-ace0-31df79383ef3","Type":"ContainerStarted","Data":"eff1030fc4b8c2d6ced69c63efcf510d4b7c565e7b10e298a1adfad0ecd5bbb2"} Jul 07 15:13:16.587795 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.587762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" event={"ID":"2378cf83-8919-41a6-a66b-9f72cbda1c31","Type":"ContainerStarted","Data":"9093409f6eee312df316288a18bdc48adf2c6f3a2ec0266f253aced72c056e97"} Jul 07 15:13:16.589337 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.589311 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerStarted","Data":"9f440112ec84d79809b3dbaad61a392a4d872478bea8d90f0674a74ce56a986f"} Jul 07 15:13:16.590877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.590850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsnkl" event={"ID":"d63fd4d5-a176-458a-8da3-50eb960edd95","Type":"ContainerStarted","Data":"bd09047fee05006c60a06ab0835ff2784c784236f0448bb67d35cf351e89361b"} Jul 07 15:13:16.592473 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.592449 2564 generic.go:356] "Generic (PLEG): container finished" podID="07cc2de8cb98e91a5f3c674fe90aba6e" containerID="6cf0c3e34052be9689b6d6c77e44ff55ef02710b601ca8262e39229a076223b0" exitCode=0 Jul 07 15:13:16.592582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.592533 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" event={"ID":"07cc2de8cb98e91a5f3c674fe90aba6e","Type":"ContainerDied","Data":"6cf0c3e34052be9689b6d6c77e44ff55ef02710b601ca8262e39229a076223b0"} Jul 07 15:13:16.596075 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.596053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gg2qn" event={"ID":"8f966d03-c5f8-4060-9710-9e395755005b","Type":"ContainerStarted","Data":"5bcbc68340ca7767a4409a27fc7d08db8fc6b78231b19fcb491579ec7cc7c61f"} Jul 07 15:13:16.602729 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.602686 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7v999" podStartSLOduration=4.025693311 podStartE2EDuration="14.602670104s" totalImagesPullingTime="10.576976793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:16.60220101 +0000 UTC m=+16.710596137" watchObservedRunningTime="2026-07-07 15:13:16.602670104 +0000 UTC m=+16.711065254" Jul 07 15:13:16.603053 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.603024 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4pqrz" podStartSLOduration=4.065557928 podStartE2EDuration="14.6030162s" totalImagesPullingTime="10.537458272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:15.59864975 +0000 UTC m=+15.707044888" watchObservedRunningTime="2026-07-07 15:13:16.6030162 +0000 UTC m=+16.711411326" Jul 07 15:13:16.654272 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.654222 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gg2qn" podStartSLOduration=4.146186925 podStartE2EDuration="14.654206351s" totalImagesPullingTime="10.508019426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:16.653973728 +0000 UTC m=+16.762368855" watchObservedRunningTime="2026-07-07 15:13:16.654206351 +0000 UTC m=+16.762601478" Jul 07 15:13:16.654426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:16.654310 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wsnkl" podStartSLOduration=5.064281814 podStartE2EDuration="15.654306076s" totalImagesPullingTime="10.590024262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:16.635755265 +0000 UTC m=+16.744150392" watchObservedRunningTime="2026-07-07 15:13:16.654306076 +0000 UTC m=+16.762701215" Jul 07 15:13:17.147020 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:17.146983 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:17.147685 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:17.147659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:17.516348 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:17.516253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:17.516516 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:17.516253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:17.516516 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:17.516386 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:17.516516 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:17.516477 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:17.598811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:17.598778 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:17.599732 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:17.599699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7v999" Jul 07 15:13:18.516039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:18.516004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:18.516261 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:18.516132 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:19.178096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:19.178058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:19.178715 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:19.178131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:19.178715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.178208 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:19.178715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.178235 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:19.178715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.178303 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:35.178279004 +0000 UTC m=+35.286674120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:19.178715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.178324 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:13:35.178315204 +0000 UTC m=+35.286710308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:19.278878 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:19.278848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:19.279033 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.279010 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:19.279033 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.279027 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:19.279108 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.279036 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:19.279108 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.279086 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:35.279071986 +0000 UTC m=+35.387467093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:19.516694 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:19.516611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:19.516875 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:19.516611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:19.516875 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.516739 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:19.516875 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:19.516810 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:20.516361 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:20.516130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:20.516793 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:20.516467 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:20.605778 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:20.605741 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce" containerID="9f440112ec84d79809b3dbaad61a392a4d872478bea8d90f0674a74ce56a986f" exitCode=0 Jul 07 15:13:20.605933 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:20.605790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerDied","Data":"9f440112ec84d79809b3dbaad61a392a4d872478bea8d90f0674a74ce56a986f"} Jul 07 15:13:21.516987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:21.516947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:21.517451 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:21.517049 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:21.517451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:21.517110 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:21.517451 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:21.517222 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:22.515842 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:22.515804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:22.516006 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:22.515927 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:23.516146 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:23.516087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:23.516146 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:23.516141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:23.516804 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:23.516234 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:23.516804 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:23.516364 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:24.205876 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.205215 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 15:13:24.412787 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.412475 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:13:24.205230857Z","UUID":"069759ca-8dcb-4d88-8e6a-09c2ea4f1240","Handler":null,"Name":"","Endpoint":""} Jul 07 15:13:24.414255 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.414236 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 15:13:24.414345 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.414280 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 15:13:24.516642 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.516599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:24.517157 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:24.516741 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:24.614841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.614789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" event={"ID":"2378cf83-8919-41a6-a66b-9f72cbda1c31","Type":"ContainerStarted","Data":"d6f98c9adadc34f555ea3482d9a1e2bf3a297637dbebc179084aeefaa3198449"} Jul 07 15:13:24.616541 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.616509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" event={"ID":"07cc2de8cb98e91a5f3c674fe90aba6e","Type":"ContainerStarted","Data":"e901cc72ab13db75a22ee2588637cc0f74623ccd20edb47d695621e15087b4ce"} Jul 07 15:13:24.619341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.619319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"bda5356fa8b7429b447e5c90b849fe790879c739ccb8a670d58d868ec749cfec"} Jul 07 15:13:24.619432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.619380 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"444a12ad785cbdd870d05087e0a57bfd638892783dce255c43ba0f9ba9f16b8c"} Jul 07 15:13:24.619432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.619411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"3fb8761a76f7aca39a60bf284d1e5e352f74a305203b5a91fcb7e129da3f29f8"} Jul 07 15:13:24.619530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.619438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"219b39121db09e6fb58b1ce5a70e8afc2f9c6a12e2f77c622633ecee61fab3bb"} Jul 07 15:13:24.619530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.619479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"337a8139e8a57b1f0a96554fdd86860c660d5b27ca481df0d9e8da24a27bcff5"} Jul 07 15:13:24.619530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.619526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"e2fb65f9ecc7a3cdb9d25e48689bab953caa82ce7235526367a64ac9ed92019d"} Jul 07 15:13:24.620730 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.620710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxzgh" event={"ID":"97b55eb8-b533-42cf-b9b5-8472e4c3ba9f","Type":"ContainerStarted","Data":"b0263b339253ad25b8a0d97875a166d6449a68c934ae9088f763b1b5dac3decd"} Jul 07 15:13:24.632652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.632618 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" podStartSLOduration=21.632607987 podStartE2EDuration="21.632607987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:24.632438178 +0000 UTC m=+24.740833306" watchObservedRunningTime="2026-07-07 15:13:24.632607987 +0000 UTC m=+24.741003113" Jul 07 15:13:24.650211 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:24.650175 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gxzgh" podStartSLOduration=2.311318286 podStartE2EDuration="22.650150077s" totalImagesPullingTime="20.338831791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:24.649987936 +0000 UTC m=+24.758383061" watchObservedRunningTime="2026-07-07 15:13:24.650150077 +0000 UTC m=+24.758545203" Jul 07 15:13:25.516642 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:25.516607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:25.517100 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:25.516607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:25.517100 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:25.516726 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:25.517100 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:25.516797 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:26.516634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:26.516613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:26.516735 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:26.516704 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:26.630877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:26.630691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"635fad863d0d0f8d3e4fb9879a797b977a3494be5fc23b8b36e49ffdd1edf050"} Jul 07 15:13:26.633578 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:26.633108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" event={"ID":"2378cf83-8919-41a6-a66b-9f72cbda1c31","Type":"ContainerStarted","Data":"df360d73f1dcd984b2536d9ff48023835206da203b73a5bf21f8812b53482aff"} Jul 07 15:13:26.654501 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:26.654446 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv5hb" podStartSLOduration=5.157079032 podStartE2EDuration="25.654425525s" totalImagesPullingTime="20.497346493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:26.65276908 +0000 UTC m=+26.761164231" watchObservedRunningTime="2026-07-07 15:13:26.654425525 +0000 UTC m=+26.762820652" Jul 07 15:13:27.516581 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:27.516548 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:27.516768 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:27.516549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:27.516768 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:27.516661 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:27.516768 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:27.516757 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:28.516847 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:28.516753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:28.517211 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:28.516898 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:29.515943 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.515741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:29.516051 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.515814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:29.516051 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:29.516034 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:29.516160 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:29.516139 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:29.644333 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.644280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" event={"ID":"884e4b7a-1ab6-4b17-b08d-c77e3d750636","Type":"ContainerStarted","Data":"a2554d8e640bf2d07469948d0c8a0a5e2cc668f319bf993cee4da51d43dacfd7"} Jul 07 15:13:29.644906 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.644534 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:29.644906 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.644720 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:29.644906 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.644774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:29.646950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.646921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerStarted","Data":"ee3a85a936b1f4fab051edb795a75b384e96f035a10af89ff03c13fdf89927ee"} Jul 07 15:13:29.661154 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.660745 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:29.661202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.661180 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:13:29.682173 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:29.682131 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" podStartSLOduration=7.304391189 podStartE2EDuration="27.68211758s" totalImagesPullingTime="20.377726391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:29.681541342 +0000 UTC m=+29.789936470" watchObservedRunningTime="2026-07-07 15:13:29.68211758 +0000 UTC m=+29.790512705" Jul 07 15:13:30.516557 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:30.516512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:30.516734 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:30.516628 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:30.650273 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:30.650246 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce" containerID="ee3a85a936b1f4fab051edb795a75b384e96f035a10af89ff03c13fdf89927ee" exitCode=0 Jul 07 15:13:30.650668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:30.650322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerDied","Data":"ee3a85a936b1f4fab051edb795a75b384e96f035a10af89ff03c13fdf89927ee"} Jul 07 15:13:31.455716 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.455687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jslxj"] Jul 07 15:13:31.456715 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.455907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:31.456715 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:31.456022 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:31.458791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.458767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vhcw"] Jul 07 15:13:31.459034 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.459016 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:31.459148 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:31.459129 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:31.474048 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.474027 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kslrs"] Jul 07 15:13:31.474142 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.474127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:31.474240 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:31.474218 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:31.654254 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.654082 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce" containerID="ee081d113e80ba0f0cbebb702b27c1b12192583e106d6e7fd85cf8482670a395" exitCode=0 Jul 07 15:13:31.654601 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:31.654154 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerDied","Data":"ee081d113e80ba0f0cbebb702b27c1b12192583e106d6e7fd85cf8482670a395"} Jul 07 15:13:32.659256 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:32.659173 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce" containerID="1ea0da8a27e55478909609a27c7cd4956a9fec66f86986e54e96e2458e221c46" exitCode=0 Jul 07 15:13:32.659256 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:32.659237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerDied","Data":"1ea0da8a27e55478909609a27c7cd4956a9fec66f86986e54e96e2458e221c46"} Jul 07 15:13:33.516622 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:33.516583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:33.516791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:33.516584 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:33.516791 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:33.516731 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:33.516791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:33.516592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:33.516990 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:33.516795 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:33.516990 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:33.516879 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:35.190226 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:35.190184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:35.190926 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:35.190246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:35.190926 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.190343 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:35.190926 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.190395 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret podName:31a1df73-0abf-416a-bbff-6a72f6419abc nodeName:}" failed. No retries permitted until 2026-07-07 15:14:07.190382275 +0000 UTC m=+67.298777378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret") pod "global-pull-secret-syncer-kslrs" (UID: "31a1df73-0abf-416a-bbff-6a72f6419abc") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:13:35.190926 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.190343 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:35.190926 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.190474 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs podName:874b35c8-99a7-4d48-b8da-8f4059630b51 nodeName:}" failed. No retries permitted until 2026-07-07 15:14:07.190461446 +0000 UTC m=+67.298856554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs") pod "network-metrics-daemon-5vhcw" (UID: "874b35c8-99a7-4d48-b8da-8f4059630b51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:13:35.291144 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:35.291108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:35.291301 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.291258 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:13:35.291301 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.291288 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:13:35.291301 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.291300 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dgdxs for pod openshift-network-diagnostics/network-check-target-jslxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:35.291414 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.291360 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs podName:6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:14:07.291346254 +0000 UTC m=+67.399741362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgdxs" (UniqueName: "kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs") pod "network-check-target-jslxj" (UID: "6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:13:35.516060 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:35.516030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:35.516060 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:35.516030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:35.516285 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.516144 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kslrs" podUID="31a1df73-0abf-416a-bbff-6a72f6419abc" Jul 07 15:13:35.516285 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:35.516154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:35.516285 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.516234 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vhcw" podUID="874b35c8-99a7-4d48-b8da-8f4059630b51" Jul 07 15:13:35.516389 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:35.516293 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jslxj" podUID="6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6" Jul 07 15:13:36.726583 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.726505 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeReady" Jul 07 15:13:36.727050 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.726669 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 15:13:36.789739 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.789622 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cf4nq"] Jul 07 15:13:36.817937 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.817906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-57qh7"] Jul 07 15:13:36.819326 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.819000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:36.822858 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.822553 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 15:13:36.822858 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.822569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pb8qd\"" Jul 07 15:13:36.823030 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.822865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 15:13:36.835858 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.835763 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cf4nq"] Jul 07 15:13:36.835858 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.835803 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-57qh7"] Jul 07 15:13:36.835858 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.835854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:36.839853 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.838506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 15:13:36.839853 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.839615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 15:13:36.839853 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.839626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-24msw\"" Jul 07 15:13:36.841064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.841022 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 15:13:36.902517 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.902483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-tmp-dir\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:36.902692 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.902629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-config-volume\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:36.902692 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.902662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:36.902786 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.902702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bncj\" (UniqueName: \"kubernetes.io/projected/1c5be46a-d362-49e4-9493-6e5a11879a86-kube-api-access-5bncj\") pod \"ingress-canary-57qh7\" (UID: \"1c5be46a-d362-49e4-9493-6e5a11879a86\") " pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:36.902786 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.902730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5be46a-d362-49e4-9493-6e5a11879a86-cert\") pod \"ingress-canary-57qh7\" (UID: \"1c5be46a-d362-49e4-9493-6e5a11879a86\") " pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:36.902925 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:36.902782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zst7\" (UniqueName: \"kubernetes.io/projected/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-kube-api-access-4zst7\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.003432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-config-volume\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.003432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.003432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bncj\" (UniqueName: \"kubernetes.io/projected/1c5be46a-d362-49e4-9493-6e5a11879a86-kube-api-access-5bncj\") pod \"ingress-canary-57qh7\" (UID: \"1c5be46a-d362-49e4-9493-6e5a11879a86\") " pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:37.003701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5be46a-d362-49e4-9493-6e5a11879a86-cert\") pod \"ingress-canary-57qh7\" (UID: \"1c5be46a-d362-49e4-9493-6e5a11879a86\") " pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:37.003701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zst7\" (UniqueName: \"kubernetes.io/projected/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-kube-api-access-4zst7\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.003701 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:37.003516 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:13:37.003701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-tmp-dir\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.003701 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:37.003604 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls podName:4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:37.50358076 +0000 UTC m=+37.611975923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls") pod "dns-default-cf4nq" (UID: "4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5") : secret "dns-default-metrics-tls" not found Jul 07 15:13:37.003946 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.003802 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-tmp-dir\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.004050 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.004024 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-config-volume\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.008234 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.008209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5be46a-d362-49e4-9493-6e5a11879a86-cert\") pod \"ingress-canary-57qh7\" (UID: \"1c5be46a-d362-49e4-9493-6e5a11879a86\") " pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:37.013111 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.013088 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zst7\" (UniqueName: \"kubernetes.io/projected/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-kube-api-access-4zst7\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.013264 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.013206 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bncj\" (UniqueName: \"kubernetes.io/projected/1c5be46a-d362-49e4-9493-6e5a11879a86-kube-api-access-5bncj\") pod \"ingress-canary-57qh7\" (UID: \"1c5be46a-d362-49e4-9493-6e5a11879a86\") " pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:37.149713 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.149679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-57qh7" Jul 07 15:13:37.506737 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.506701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:37.506934 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:37.506904 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:13:37.507021 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:37.506996 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls podName:4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:38.506974581 +0000 UTC m=+38.615369690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls") pod "dns-default-cf4nq" (UID: "4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5") : secret "dns-default-metrics-tls" not found Jul 07 15:13:37.516442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.516414 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:13:37.516442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.516440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:13:37.516624 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.516450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:13:37.520228 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.520195 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:13:37.520228 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.520224 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:13:37.520451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.520428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lhgw4\"" Jul 07 15:13:37.520531 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.520484 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5bbhh\"" Jul 07 15:13:37.520588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.520542 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:13:37.520642 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:37.520595 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:13:38.139852 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:38.139649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-57qh7"] Jul 07 15:13:38.189379 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:38.189335 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5be46a_d362_49e4_9493_6e5a11879a86.slice/crio-a1dfcccf2aa348550a66776d02e22bf1d2f16acbcc4c0d0b13f7f3b732647975 WatchSource:0}: Error finding container a1dfcccf2aa348550a66776d02e22bf1d2f16acbcc4c0d0b13f7f3b732647975: Status 404 returned error can't find the container with id a1dfcccf2aa348550a66776d02e22bf1d2f16acbcc4c0d0b13f7f3b732647975 Jul 07 15:13:38.514939 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:38.514847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:38.515087 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:38.514999 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:13:38.515087 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:38.515061 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls podName:4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:40.515047011 +0000 UTC m=+40.623442114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls") pod "dns-default-cf4nq" (UID: "4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5") : secret "dns-default-metrics-tls" not found Jul 07 15:13:38.675557 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:38.675526 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce" containerID="691c7c652bdf7d1ae9b09c8dd93721f9688371144ed5f020ff522076d05adf9a" exitCode=0 Jul 07 15:13:38.675732 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:38.675602 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerDied","Data":"691c7c652bdf7d1ae9b09c8dd93721f9688371144ed5f020ff522076d05adf9a"} Jul 07 15:13:38.676757 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:38.676738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-57qh7" event={"ID":"1c5be46a-d362-49e4-9493-6e5a11879a86","Type":"ContainerStarted","Data":"a1dfcccf2aa348550a66776d02e22bf1d2f16acbcc4c0d0b13f7f3b732647975"} Jul 07 15:13:39.683054 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:39.683021 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce" containerID="34c2653a2c96698b22829f50cbf94cf046874c54a46d2813ee773643975b98b6" exitCode=0 Jul 07 15:13:39.683515 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:39.683074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerDied","Data":"34c2653a2c96698b22829f50cbf94cf046874c54a46d2813ee773643975b98b6"} Jul 07 15:13:40.424712 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.424674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:40.519140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.519105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:40.532263 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.532234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:40.532413 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:40.532396 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:13:40.532488 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:40.532479 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls podName:4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:44.532449977 +0000 UTC m=+44.640845080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls") pod "dns-default-cf4nq" (UID: "4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5") : secret "dns-default-metrics-tls" not found Jul 07 15:13:40.620030 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.619999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:40.688647 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.688567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" event={"ID":"d6b1efc6-b834-4f7b-9ea0-d992b52ab1ce","Type":"ContainerStarted","Data":"3d5f3e6ea44692a251fff94e246d51ee1f1183d79739e46082309933380db7cd"} Jul 07 15:13:40.717993 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.717943 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9xmj5" podStartSLOduration=12.24537692 podStartE2EDuration="38.717922192s" totalImagesPullingTime="26.472545272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:40.717468701 +0000 UTC m=+40.825863830" watchObservedRunningTime="2026-07-07 15:13:40.717922192 +0000 UTC m=+40.826317322" Jul 07 15:13:40.844245 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.844213 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:40.916195 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.916165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:40.980438 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:40.980354 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:41.525328 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:41.525064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:41.626875 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:41.626842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:41.692176 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:41.692146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:41.919163 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:41.919091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:42.017971 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:42.017945 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:42.094370 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:42.094343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:42.391580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:42.391552 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:42.451372 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:42.451341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:42.693854 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:42.693764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-57qh7" event={"ID":"1c5be46a-d362-49e4-9493-6e5a11879a86","Type":"ContainerStarted","Data":"2e60efe527348df406919a3d3526dca0767f5a3a3cda30207d476489776501a6"} Jul 07 15:13:42.711898 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:42.711861 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-57qh7" podStartSLOduration=2.912327277 podStartE2EDuration="6.711847912s" totalImagesPullingTime="3.799520635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:42.71095116 +0000 UTC m=+42.819346286" watchObservedRunningTime="2026-07-07 15:13:42.711847912 +0000 UTC m=+42.820243029" Jul 07 15:13:44.560166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:44.560127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:44.560636 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:44.560288 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:13:44.560636 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:44.560353 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls podName:4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:52.560338485 +0000 UTC m=+52.668733588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls") pod "dns-default-cf4nq" (UID: "4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5") : secret "dns-default-metrics-tls" not found Jul 07 15:13:47.886149 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:47.886116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:47.969530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:47.969499 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb"] Jul 07 15:13:47.991993 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:47.991956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.004023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.004003 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb"] Jul 07 15:13:48.004147 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.004092 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" Jul 07 15:13:48.009177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.009156 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 15:13:48.009382 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.009363 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6xhxs\"" Jul 07 15:13:48.009939 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.009920 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 15:13:48.063326 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.063295 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lmkr5"] Jul 07 15:13:48.083808 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.083781 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lmkr5"] Jul 07 15:13:48.083920 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.083907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.086125 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.086105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f9ph\" (UniqueName: \"kubernetes.io/projected/504a424b-4093-4cd3-854f-9bb49917db9d-kube-api-access-7f9ph\") pod \"migrator-d57d58cc9-b4xwb\" (UID: \"504a424b-4093-4cd3-854f-9bb49917db9d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" Jul 07 15:13:48.087107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.087085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 15:13:48.087351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.087335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-265hp\"" Jul 07 15:13:48.087646 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.087626 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 15:13:48.087854 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.087644 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 15:13:48.088153 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.088137 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 15:13:48.089872 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.089809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.184699 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.184606 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.186615 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.186598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d8d1282-8e61-4b59-8fc1-5b8720c45209-crio-socket\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.186689 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.186624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.186689 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.186659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.186795 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.186723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f9ph\" (UniqueName: \"kubernetes.io/projected/504a424b-4093-4cd3-854f-9bb49917db9d-kube-api-access-7f9ph\") pod \"migrator-d57d58cc9-b4xwb\" (UID: \"504a424b-4093-4cd3-854f-9bb49917db9d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" Jul 07 15:13:48.186795 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.186759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8d1282-8e61-4b59-8fc1-5b8720c45209-data-volume\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.186918 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.186815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbvw\" (UniqueName: \"kubernetes.io/projected/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-api-access-kcbvw\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.202103 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.202071 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f9ph\" (UniqueName: \"kubernetes.io/projected/504a424b-4093-4cd3-854f-9bb49917db9d-kube-api-access-7f9ph\") pod \"migrator-d57d58cc9-b4xwb\" (UID: \"504a424b-4093-4cd3-854f-9bb49917db9d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" Jul 07 15:13:48.287368 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d8d1282-8e61-4b59-8fc1-5b8720c45209-crio-socket\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.287368 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.287540 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.287540 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8d1282-8e61-4b59-8fc1-5b8720c45209-data-volume\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.287540 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbvw\" (UniqueName: \"kubernetes.io/projected/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-api-access-kcbvw\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.287540 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.287491 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:13:48.287540 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.287515 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:13:48.287690 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d8d1282-8e61-4b59-8fc1-5b8720c45209-crio-socket\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.287690 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.287587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:48.787567936 +0000 UTC m=+48.895963066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : secret "insights-runtime-extractor-tls" not found Jul 07 15:13:48.287690 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.287604 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:48.787596148 +0000 UTC m=+48.895991252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : configmap "kube-rbac-proxy" not found Jul 07 15:13:48.287884 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.287864 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8d1282-8e61-4b59-8fc1-5b8720c45209-data-volume\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.307997 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.307965 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbvw\" (UniqueName: \"kubernetes.io/projected/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-api-access-kcbvw\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.312580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.312551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" Jul 07 15:13:48.319986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.319957 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.458757 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.458681 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb"] Jul 07 15:13:48.462237 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:13:48.462207 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504a424b_4093_4cd3_854f_9bb49917db9d.slice/crio-659916f2699009e42bf0a62adced481f2416f106c7529558c57ad0d2bc4851a5 WatchSource:0}: Error finding container 659916f2699009e42bf0a62adced481f2416f106c7529558c57ad0d2bc4851a5: Status 404 returned error can't find the container with id 659916f2699009e42bf0a62adced481f2416f106c7529558c57ad0d2bc4851a5 Jul 07 15:13:48.559404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.559367 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.659844 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.659802 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.708863 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.708775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" event={"ID":"504a424b-4093-4cd3-854f-9bb49917db9d","Type":"ContainerStarted","Data":"659916f2699009e42bf0a62adced481f2416f106c7529558c57ad0d2bc4851a5"} Jul 07 15:13:48.790380 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.790341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.790541 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.790402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:48.790541 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.790436 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:13:48.790541 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.790516 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:49.79049695 +0000 UTC m=+49.898892087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : configmap "kube-rbac-proxy" not found Jul 07 15:13:48.790541 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.790535 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:13:48.790695 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:48.790576 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:49.790562319 +0000 UTC m=+49.898957428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : secret "insights-runtime-extractor-tls" not found Jul 07 15:13:48.802822 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.802792 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.884903 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.884858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:48.987795 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:48.987713 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:49.797150 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:49.797115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:49.797375 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:49.797220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:49.797375 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:49.797272 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:13:49.797375 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:49.797297 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:13:49.797375 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:49.797340 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:51.797323437 +0000 UTC m=+51.905718558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : secret "insights-runtime-extractor-tls" not found Jul 07 15:13:49.797375 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:49.797355 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:51.79734817 +0000 UTC m=+51.905743273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : configmap "kube-rbac-proxy" not found Jul 07 15:13:50.598120 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.598092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:50.706738 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.706663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:50.714639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.714616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" event={"ID":"504a424b-4093-4cd3-854f-9bb49917db9d","Type":"ContainerStarted","Data":"c44a4adea6e5a68c353ec1650715f40471b9504f4204cd32a2b25387a34c4987"} Jul 07 15:13:50.714764 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.714684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" event={"ID":"504a424b-4093-4cd3-854f-9bb49917db9d","Type":"ContainerStarted","Data":"e963dcf6e4f8e5df333c9c6193bee200210675e0eeb5878c21bb3d5cfeeb493e"} Jul 07 15:13:50.740414 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.740363 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b4xwb" podStartSLOduration=1.79013066 podStartE2EDuration="3.740349626s" totalImagesPullingTime="1.950218966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:50.73989581 +0000 UTC m=+50.848290937" watchObservedRunningTime="2026-07-07 15:13:50.740349626 +0000 UTC m=+50.848744729" Jul 07 15:13:50.825905 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.825881 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gg2qn_8f966d03-c5f8-4060-9710-9e395755005b/dns-node-resolver/0.log" Jul 07 15:13:50.901610 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.901577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:50.998149 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:50.998061 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:51.634283 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:51.634257 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsnkl_d63fd4d5-a176-458a-8da3-50eb960edd95/node-ca/0.log" Jul 07 15:13:51.814968 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:51.814936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:51.815149 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:51.814985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:51.815149 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:51.815068 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:13:51.815149 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:51.815105 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:13:51.815149 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:51.815139 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:55.815121268 +0000 UTC m=+55.923516375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : configmap "kube-rbac-proxy" not found Jul 07 15:13:51.815298 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:51.815158 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:13:55.815149261 +0000 UTC m=+55.923544365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : secret "insights-runtime-extractor-tls" not found Jul 07 15:13:52.229059 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:52.229033 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-57qh7_1c5be46a-d362-49e4-9493-6e5a11879a86/serve-healthcheck-canary/0.log" Jul 07 15:13:52.397923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:52.397895 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:52.619898 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:52.619866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:13:52.620052 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:52.620014 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:13:52.620099 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:52.620088 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls podName:4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5 nodeName:}" failed. No retries permitted until 2026-07-07 15:14:08.620063002 +0000 UTC m=+68.728458106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls") pod "dns-default-cf4nq" (UID: "4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5") : secret "dns-default-metrics-tls" not found Jul 07 15:13:52.826275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:52.826246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-b4xwb_504a424b-4093-4cd3-854f-9bb49917db9d/migrator/0.log" Jul 07 15:13:53.021613 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:53.021507 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-b4xwb_504a424b-4093-4cd3-854f-9bb49917db9d/graceful-termination/0.log" Jul 07 15:13:54.725713 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:54.725684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:55.596703 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:55.596634 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:55.742877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:55.742819 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:55.841591 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:55.841555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:55.841794 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:55.841608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:13:55.841794 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:55.841701 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:13:55.841794 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:55.841750 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:14:03.841737855 +0000 UTC m=+63.950132958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : secret "insights-runtime-extractor-tls" not found Jul 07 15:13:55.841948 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:55.841795 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:13:55.841948 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:13:55.841874 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:14:03.841858847 +0000 UTC m=+63.950253956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : configmap "kube-rbac-proxy" not found Jul 07 15:13:55.844882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:55.844857 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:55.942840 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:55.942734 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:56.042912 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:56.042874 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:56.494040 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:56.494011 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:57.116882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:57.116814 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:57.510244 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:57.510153 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:57.684281 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:57.684248 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:57.882148 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:57.882117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:58.798247 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:58.798217 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:58.900617 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:58.900593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:58.998921 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:58.998894 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:59.100084 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:59.100011 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:59.278925 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:59.278891 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:59.352987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:59.352914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:59.679572 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:13:59.679480 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:00.279856 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:00.279815 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:00.674502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:00.674410 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:00.775312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:00.775281 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:00.876917 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:00.876880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:00.975489 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:00.975412 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:01.077668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:01.077634 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:01.474047 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:01.474019 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:01.674249 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:01.674222 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-72z5s" Jul 07 15:14:01.919501 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:01.919471 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:02.079434 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:02.079399 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:02.276141 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:02.276110 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:02.506019 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:02.505987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:02.671649 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:02.671565 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:03.694600 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:03.694570 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:03.897508 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:03.897472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:14:03.897682 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:03.897518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:14:03.897682 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:14:03.897607 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:14:03.897756 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:14:03.897732 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls podName:0d8d1282-8e61-4b59-8fc1-5b8720c45209 nodeName:}" failed. No retries permitted until 2026-07-07 15:14:19.897714545 +0000 UTC m=+80.006109650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lmkr5" (UID: "0d8d1282-8e61-4b59-8fc1-5b8720c45209") : secret "insights-runtime-extractor-tls" not found Jul 07 15:14:03.897987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:03.897966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d1282-8e61-4b59-8fc1-5b8720c45209-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:14:04.088025 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:04.087996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:04.299884 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:04.299853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:04.481052 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:04.480963 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:04.695884 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:04.695852 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:05.706144 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:05.706118 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:05.889738 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:05.889712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:06.089045 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:06.089015 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:06.289731 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:06.289694 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:07.219918 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.219885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:14:07.220300 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.219948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:14:07.224533 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.224506 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:14:07.225472 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.225461 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:14:07.232879 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.232849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31a1df73-0abf-416a-bbff-6a72f6419abc-original-pull-secret\") pod \"global-pull-secret-syncer-kslrs\" (UID: \"31a1df73-0abf-416a-bbff-6a72f6419abc\") " pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:14:07.232879 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.232866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/874b35c8-99a7-4d48-b8da-8f4059630b51-metrics-certs\") pod \"network-metrics-daemon-5vhcw\" (UID: \"874b35c8-99a7-4d48-b8da-8f4059630b51\") " pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:14:07.243665 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.243643 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lhgw4\"" Jul 07 15:14:07.251121 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.251104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vhcw" Jul 07 15:14:07.320613 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.320582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:14:07.323168 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.323137 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:14:07.333511 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.333491 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:14:07.344131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.344105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdxs\" (UniqueName: \"kubernetes.io/projected/6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6-kube-api-access-dgdxs\") pod \"network-check-target-jslxj\" (UID: \"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6\") " pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:14:07.374025 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.373994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vhcw"] Jul 07 15:14:07.376712 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:07.376688 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874b35c8_99a7_4d48_b8da_8f4059630b51.slice/crio-7100e44b16d4e70a8eb0fd4ca6ebe8b174cb877ea5bed7906abcb2ab22d0caaa WatchSource:0}: Error finding container 7100e44b16d4e70a8eb0fd4ca6ebe8b174cb877ea5bed7906abcb2ab22d0caaa: Status 404 returned error can't find the container with id 7100e44b16d4e70a8eb0fd4ca6ebe8b174cb877ea5bed7906abcb2ab22d0caaa Jul 07 15:14:07.527694 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.527672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kslrs" Jul 07 15:14:07.538500 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.538479 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5bbhh\"" Jul 07 15:14:07.546515 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.546490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:14:07.684980 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.684949 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kslrs"] Jul 07 15:14:07.688208 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:07.688177 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a1df73_0abf_416a_bbff_6a72f6419abc.slice/crio-75b94f826f5791641dc54044a0c638818847b7a5636b3d29f2ca0bebd50df50d WatchSource:0}: Error finding container 75b94f826f5791641dc54044a0c638818847b7a5636b3d29f2ca0bebd50df50d: Status 404 returned error can't find the container with id 75b94f826f5791641dc54044a0c638818847b7a5636b3d29f2ca0bebd50df50d Jul 07 15:14:07.709737 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.709709 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jslxj"] Jul 07 15:14:07.712305 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:07.712283 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f802d0d_4997_4de1_9ac2_3c7dc8ce25f6.slice/crio-ca06b8e58a435ab12e5418ee6553cf6093b1b50817245c9a874b928e690b35f3 WatchSource:0}: Error finding container ca06b8e58a435ab12e5418ee6553cf6093b1b50817245c9a874b928e690b35f3: Status 404 returned error can't find the container with id ca06b8e58a435ab12e5418ee6553cf6093b1b50817245c9a874b928e690b35f3 Jul 07 15:14:07.755045 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.754992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vhcw" event={"ID":"874b35c8-99a7-4d48-b8da-8f4059630b51","Type":"ContainerStarted","Data":"7100e44b16d4e70a8eb0fd4ca6ebe8b174cb877ea5bed7906abcb2ab22d0caaa"} Jul 07 15:14:07.756145 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.756120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jslxj" event={"ID":"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6","Type":"ContainerStarted","Data":"ca06b8e58a435ab12e5418ee6553cf6093b1b50817245c9a874b928e690b35f3"} Jul 07 15:14:07.757075 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:07.757055 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kslrs" event={"ID":"31a1df73-0abf-416a-bbff-6a72f6419abc","Type":"ContainerStarted","Data":"75b94f826f5791641dc54044a0c638818847b7a5636b3d29f2ca0bebd50df50d"} Jul 07 15:14:08.629211 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:08.629175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:14:08.632769 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:08.632739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5-metrics-tls\") pod \"dns-default-cf4nq\" (UID: \"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5\") " pod="openshift-dns/dns-default-cf4nq" Jul 07 15:14:08.637313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:08.637119 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pb8qd\"" Jul 07 15:14:08.644948 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:08.644902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cf4nq" Jul 07 15:14:08.936368 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:08.936287 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cf4nq"] Jul 07 15:14:08.948008 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:08.947971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0b46b9_9b56_4ffd_bb9b_2928cf0620b5.slice/crio-e3efc315a18f1d2d82d15871e16341850558c5ed458f9a3a3c0d2f9120bcba26 WatchSource:0}: Error finding container e3efc315a18f1d2d82d15871e16341850558c5ed458f9a3a3c0d2f9120bcba26: Status 404 returned error can't find the container with id e3efc315a18f1d2d82d15871e16341850558c5ed458f9a3a3c0d2f9120bcba26 Jul 07 15:14:09.764363 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:09.764324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf4nq" event={"ID":"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5","Type":"ContainerStarted","Data":"e3efc315a18f1d2d82d15871e16341850558c5ed458f9a3a3c0d2f9120bcba26"} Jul 07 15:14:09.766605 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:09.766556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vhcw" event={"ID":"874b35c8-99a7-4d48-b8da-8f4059630b51","Type":"ContainerStarted","Data":"9c57576ca5d78bad5b2dbfa537a521698e777651f77e6d894929bfb2e6ae2a3a"} Jul 07 15:14:09.766605 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:09.766604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vhcw" event={"ID":"874b35c8-99a7-4d48-b8da-8f4059630b51","Type":"ContainerStarted","Data":"4e6eef4253c83f494e844063fe6288194e1224a64ef5566d8a7d4412d5216405"} Jul 07 15:14:10.384496 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:10.384462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:10.452422 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:10.452386 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:13.781873 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.781824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jslxj" event={"ID":"6f802d0d-4997-4de1-9ac2-3c7dc8ce25f6","Type":"ContainerStarted","Data":"25220f9618b70e6d8db1380e49f1c39546d3be433349945bec2a4bc414636730"} Jul 07 15:14:13.782340 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.781981 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:14:13.783559 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.783526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kslrs" event={"ID":"31a1df73-0abf-416a-bbff-6a72f6419abc","Type":"ContainerStarted","Data":"393c262b24bba54f2a79ced05d171de26b28404dca3981ff79d968b5a2766a40"} Jul 07 15:14:13.785442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.785418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf4nq" event={"ID":"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5","Type":"ContainerStarted","Data":"64909d66771f98ced06a9f7d3ff57f0ffc0fb9aa4b20601a75c7f17b94aae90c"} Jul 07 15:14:13.785545 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.785464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf4nq" event={"ID":"4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5","Type":"ContainerStarted","Data":"ac5a39f3f5ea26970fd96db00ceb0b9a5d18f1d3a716002d60597450d00f9084"} Jul 07 15:14:13.785545 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.785499 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cf4nq" Jul 07 15:14:13.803188 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.803146 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5vhcw" podStartSLOduration=70.228145045 podStartE2EDuration="1m11.803105714s" totalImagesPullingTime="1.574960669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:09.805355034 +0000 UTC m=+69.913750160" watchObservedRunningTime="2026-07-07 15:14:13.803105714 +0000 UTC m=+73.911500840" Jul 07 15:14:13.803630 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.803601 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jslxj" podStartSLOduration=66.088265468 podStartE2EDuration="1m11.80359434s" totalImagesPullingTime="5.715328872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:13.80255033 +0000 UTC m=+73.910945458" watchObservedRunningTime="2026-07-07 15:14:13.80359434 +0000 UTC m=+73.911989463" Jul 07 15:14:13.812196 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.812175 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf"] Jul 07 15:14:13.815036 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.815022 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.817694 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.817652 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 15:14:13.817804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.817698 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 15:14:13.817804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.817705 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 15:14:13.817804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.817755 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 15:14:13.817804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.817788 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 15:14:13.818058 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.817805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 15:14:13.818058 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.818047 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 15:14:13.822058 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.822023 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kslrs" podStartSLOduration=66.068946407 podStartE2EDuration="1m11.822011974s" totalImagesPullingTime="5.753065567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:13.820640876 +0000 UTC m=+73.929036013" watchObservedRunningTime="2026-07-07 15:14:13.822011974 +0000 UTC m=+73.930407091" Jul 07 15:14:13.831169 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.829472 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf"] Jul 07 15:14:13.843154 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.843116 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cf4nq" podStartSLOduration=33.362051925 podStartE2EDuration="37.843104046s" totalImagesPullingTime="4.481052121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:13.842248028 +0000 UTC m=+73.950643177" watchObservedRunningTime="2026-07-07 15:14:13.843104046 +0000 UTC m=+73.951499172" Jul 07 15:14:13.869086 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.869060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-ca\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.869186 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.869099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-hub\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.869268 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.869246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.869322 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.869277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.869362 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.869338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4548863a-842d-4468-b08c-5506f7fc15ef-additional-service-ca\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.869406 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.869364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4vn\" (UniqueName: \"kubernetes.io/projected/4548863a-842d-4468-b08c-5506f7fc15ef-kube-api-access-6m4vn\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.932230 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.932209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:13.970327 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.970301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-hub\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.970435 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.970343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.970435 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.970361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.970528 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.970488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4548863a-842d-4468-b08c-5506f7fc15ef-additional-service-ca\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.970563 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.970529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4vn\" (UniqueName: \"kubernetes.io/projected/4548863a-842d-4468-b08c-5506f7fc15ef-kube-api-access-6m4vn\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.970607 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.970578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-ca\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.971197 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.971172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4548863a-842d-4468-b08c-5506f7fc15ef-additional-service-ca\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.972850 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.972797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-ca\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.973126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.973106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-hub\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.973126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.973113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.973261 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.973226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4548863a-842d-4468-b08c-5506f7fc15ef-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:13.974082 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.974062 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b7d56df6c-bkzqw"] Jul 07 15:14:13.977073 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.977057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:13.979570 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.979554 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-st7wq\"" Jul 07 15:14:13.980004 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.979986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 15:14:13.980091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.979992 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 15:14:13.980150 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.980116 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 15:14:13.982394 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:13.982378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4vn\" (UniqueName: \"kubernetes.io/projected/4548863a-842d-4468-b08c-5506f7fc15ef-kube-api-access-6m4vn\") pod \"cluster-proxy-proxy-agent-599967996c-d8ndf\" (UID: \"4548863a-842d-4468-b08c-5506f7fc15ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:14.003736 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.003718 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 15:14:14.018474 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.018450 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7d56df6c-bkzqw"] Jul 07 15:14:14.044179 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.044109 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:14.071313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-trusted-ca\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071425 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-bound-sa-token\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071425 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-registry-tls\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-ca-trust-extracted\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-installation-pull-secrets\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-image-registry-private-configuration\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-registry-certificates\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.071668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.071562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mptn\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-kube-api-access-7mptn\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.139365 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.139336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" Jul 07 15:14:14.140276 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.140255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:14.172449 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-installation-pull-secrets\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172449 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-image-registry-private-configuration\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172663 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-registry-certificates\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172663 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mptn\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-kube-api-access-7mptn\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172663 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-trusted-ca\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172663 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-bound-sa-token\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172663 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-registry-tls\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.172663 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.172614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-ca-trust-extracted\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.173342 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.173311 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-ca-trust-extracted\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.173542 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.173511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-trusted-ca\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.173542 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.173531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-registry-certificates\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.175069 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.175038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-image-registry-private-configuration\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.175310 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.175289 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-registry-tls\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.175389 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.175370 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-installation-pull-secrets\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.182800 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.182775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-bound-sa-token\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.182913 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.182898 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mptn\" (UniqueName: \"kubernetes.io/projected/9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8-kube-api-access-7mptn\") pod \"image-registry-5b7d56df6c-bkzqw\" (UID: \"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8\") " pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.241719 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.241684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:14.269849 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.269801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf"] Jul 07 15:14:14.272892 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:14.272863 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4548863a_842d_4468_b08c_5506f7fc15ef.slice/crio-c4fd5cf7401ae00820729e783a44d0a820eff9b0b21a13119d3c8ab9df7ef944 WatchSource:0}: Error finding container c4fd5cf7401ae00820729e783a44d0a820eff9b0b21a13119d3c8ab9df7ef944: Status 404 returned error can't find the container with id c4fd5cf7401ae00820729e783a44d0a820eff9b0b21a13119d3c8ab9df7ef944 Jul 07 15:14:14.286412 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.286390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.342870 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.342811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:14.420205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.420177 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7d56df6c-bkzqw"] Jul 07 15:14:14.422954 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:14.422931 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4cd0b5_afb5_46c2_97c4_16dd44d68ac8.slice/crio-898fc76aca5964328412f0d655b4e6ac1178ea936f001645fff4a92e795aee63 WatchSource:0}: Error finding container 898fc76aca5964328412f0d655b4e6ac1178ea936f001645fff4a92e795aee63: Status 404 returned error can't find the container with id 898fc76aca5964328412f0d655b4e6ac1178ea936f001645fff4a92e795aee63 Jul 07 15:14:14.791448 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.791408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" event={"ID":"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8","Type":"ContainerStarted","Data":"1354fb42b411b80b5c88a976fc8818a56cdc8aef6d096557df5b259e95a9012c"} Jul 07 15:14:14.791908 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.791477 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:14.791908 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.791499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" event={"ID":"9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8","Type":"ContainerStarted","Data":"898fc76aca5964328412f0d655b4e6ac1178ea936f001645fff4a92e795aee63"} Jul 07 15:14:14.792585 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.792559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" event={"ID":"4548863a-842d-4468-b08c-5506f7fc15ef","Type":"ContainerStarted","Data":"c4fd5cf7401ae00820729e783a44d0a820eff9b0b21a13119d3c8ab9df7ef944"} Jul 07 15:14:14.814655 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:14.814609 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" podStartSLOduration=1.814596571 podStartE2EDuration="1.814596571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:14.813749245 +0000 UTC m=+74.922144372" watchObservedRunningTime="2026-07-07 15:14:14.814596571 +0000 UTC m=+74.922991697" Jul 07 15:14:15.818092 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:15.818058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:15.967387 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:15.967324 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:16.063872 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:16.063785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:16.155958 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:16.155858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:16.256459 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:16.256388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:16.409365 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:16.409296 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:18.813214 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:18.813174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" event={"ID":"4548863a-842d-4468-b08c-5506f7fc15ef","Type":"ContainerStarted","Data":"272b90a79d65b3b29dcf549b9239ed03008f393d3aa709b8b8b06648af8ee8c0"} Jul 07 15:14:18.813646 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:18.813221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" event={"ID":"4548863a-842d-4468-b08c-5506f7fc15ef","Type":"ContainerStarted","Data":"65ff2693d746b403c1ca6be225b41aaf7f5c5667c73656ab3d4fc3a33c58380d"} Jul 07 15:14:18.813646 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:18.813239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" event={"ID":"4548863a-842d-4468-b08c-5506f7fc15ef","Type":"ContainerStarted","Data":"5b502e1653429ae99e42a2d1486ec7133530fa7f609c63dcc6c722e567efff0b"} Jul 07 15:14:18.867204 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:18.867175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:18.874191 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:18.874147 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-599967996c-d8ndf" podStartSLOduration=2.172929476 podStartE2EDuration="5.874134801s" totalImagesPullingTime="3.701205325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:18.873260873 +0000 UTC m=+78.981656000" watchObservedRunningTime="2026-07-07 15:14:18.874134801 +0000 UTC m=+78.982529926" Jul 07 15:14:19.010990 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.010955 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:19.145069 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.144985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:19.310609 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.310572 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:19.413172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.413092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:19.519973 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.519943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:19.918029 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.917994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:14:19.920303 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.920282 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d1282-8e61-4b59-8fc1-5b8720c45209-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmkr5\" (UID: \"0d8d1282-8e61-4b59-8fc1-5b8720c45209\") " pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:14:19.999157 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:19.999127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.097727 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.097696 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.195266 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.195186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-265hp\"" Jul 07 15:14:20.203275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.203259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lmkr5" Jul 07 15:14:20.331720 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.331693 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.351497 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.351425 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lmkr5"] Jul 07 15:14:20.354148 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:20.354126 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8d1282_8e61_4b59_8fc1_5b8720c45209.slice/crio-82aefd3848ecf9687a17162a58ce4f1a5ad459b109217874ebaad057359c257a WatchSource:0}: Error finding container 82aefd3848ecf9687a17162a58ce4f1a5ad459b109217874ebaad057359c257a: Status 404 returned error can't find the container with id 82aefd3848ecf9687a17162a58ce4f1a5ad459b109217874ebaad057359c257a Jul 07 15:14:20.433845 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.433787 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.529311 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.529265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.668558 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.668501 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.746089 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.746044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:20.822021 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:20.821939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmkr5" event={"ID":"0d8d1282-8e61-4b59-8fc1-5b8720c45209","Type":"ContainerStarted","Data":"82aefd3848ecf9687a17162a58ce4f1a5ad459b109217874ebaad057359c257a"} Jul 07 15:14:22.679166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:22.679006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:22.758057 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:22.758017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:23.795274 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:23.795246 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cf4nq" Jul 07 15:14:24.838660 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:24.838618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmkr5" event={"ID":"0d8d1282-8e61-4b59-8fc1-5b8720c45209","Type":"ContainerStarted","Data":"c9c862c92a15aa6d2abdd4f7ea58496c0fc8d5c4e825fced6e6c05893d439960"} Jul 07 15:14:24.839058 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:24.838706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmkr5" event={"ID":"0d8d1282-8e61-4b59-8fc1-5b8720c45209","Type":"ContainerStarted","Data":"f991b2d05dd85810e69290aa8c8e203fcd04735c013649d7444f872299d46866"} Jul 07 15:14:25.249743 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:25.249709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:27.189912 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.189873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:27.428842 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.428806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:27.521179 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.521093 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r2426"] Jul 07 15:14:27.535122 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.535093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.536936 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.536904 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:27.539690 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.539666 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 15:14:27.539807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.539741 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 15:14:27.539807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.539794 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 15:14:27.540442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.540422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 15:14:27.540564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.540488 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fzzpb\"" Jul 07 15:14:27.540564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.540523 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 15:14:27.540564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.540531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 15:14:27.573351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p5vq\" (UniqueName: \"kubernetes.io/projected/11a9f890-ef52-45fd-88e3-2fadb709e8df-kube-api-access-6p5vq\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573608 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-tls\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573608 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573608 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-wtmp\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573608 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11a9f890-ef52-45fd-88e3-2fadb709e8df-metrics-client-ca\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573848 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-sys\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573848 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-root\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.573848 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.573669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-textfile\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p5vq\" (UniqueName: \"kubernetes.io/projected/11a9f890-ef52-45fd-88e3-2fadb709e8df-kube-api-access-6p5vq\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-tls\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-wtmp\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11a9f890-ef52-45fd-88e3-2fadb709e8df-metrics-client-ca\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:14:27.674671 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-sys\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:14:27.674743 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-tls podName:11a9f890-ef52-45fd-88e3-2fadb709e8df nodeName:}" failed. No retries permitted until 2026-07-07 15:14:28.174723236 +0000 UTC m=+88.283118360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-tls") pod "node-exporter-r2426" (UID: "11a9f890-ef52-45fd-88e3-2fadb709e8df") : secret "node-exporter-tls" not found Jul 07 15:14:27.674746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-sys\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675143 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-root\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675143 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674798 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-wtmp\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675143 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-textfile\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675143 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.674961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11a9f890-ef52-45fd-88e3-2fadb709e8df-root\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675143 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.675073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-textfile\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.675176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.675312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.675195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11a9f890-ef52-45fd-88e3-2fadb709e8df-metrics-client-ca\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.676995 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.676975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.684226 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.684205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p5vq\" (UniqueName: \"kubernetes.io/projected/11a9f890-ef52-45fd-88e3-2fadb709e8df-kube-api-access-6p5vq\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:27.778268 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.778225 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:27.849684 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.849653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmkr5" event={"ID":"0d8d1282-8e61-4b59-8fc1-5b8720c45209","Type":"ContainerStarted","Data":"84904a53585d2a1f106d1e81d3046b18e8854ba1dea7a13656381b8dcc8fc8ec"} Jul 07 15:14:27.909984 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.909955 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:27.996128 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:27.996099 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:28.178934 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.178848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-tls\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:28.181076 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.181057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11a9f890-ef52-45fd-88e3-2fadb709e8df-node-exporter-tls\") pod \"node-exporter-r2426\" (UID: \"11a9f890-ef52-45fd-88e3-2fadb709e8df\") " pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:28.283445 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.283415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:28.445472 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.445380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2426" Jul 07 15:14:28.455700 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:28.455672 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a9f890_ef52_45fd_88e3_2fadb709e8df.slice/crio-668e3ad13a600bff22d4447afdf7f02b4c59f60f025d7649fe5e998f82c2d306 WatchSource:0}: Error finding container 668e3ad13a600bff22d4447afdf7f02b4c59f60f025d7649fe5e998f82c2d306: Status 404 returned error can't find the container with id 668e3ad13a600bff22d4447afdf7f02b4c59f60f025d7649fe5e998f82c2d306 Jul 07 15:14:28.472595 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.472563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:28.585154 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.585123 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:28.854232 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:28.854199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2426" event={"ID":"11a9f890-ef52-45fd-88e3-2fadb709e8df","Type":"ContainerStarted","Data":"668e3ad13a600bff22d4447afdf7f02b4c59f60f025d7649fe5e998f82c2d306"} Jul 07 15:14:29.150084 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:29.150000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:29.858928 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:29.858888 2564 generic.go:356] "Generic (PLEG): container finished" podID="11a9f890-ef52-45fd-88e3-2fadb709e8df" containerID="cde3c6f25f74d65dbf7f6cde5a0ed2e3a97f4fc7144115fc805c919965c66417" exitCode=0 Jul 07 15:14:29.859362 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:29.858939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2426" event={"ID":"11a9f890-ef52-45fd-88e3-2fadb709e8df","Type":"ContainerDied","Data":"cde3c6f25f74d65dbf7f6cde5a0ed2e3a97f4fc7144115fc805c919965c66417"} Jul 07 15:14:29.886272 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:29.886225 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lmkr5" podStartSLOduration=34.603229228000004 podStartE2EDuration="41.88621043s" totalImagesPullingTime="7.282981202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:13:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:27.900193268 +0000 UTC m=+88.008588396" watchObservedRunningTime="2026-07-07 15:14:29.88621043 +0000 UTC m=+89.994605555" Jul 07 15:14:30.483072 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:30.483039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:30.590106 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:30.590076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:30.841502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:30.841465 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:30.864117 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:30.864086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2426" event={"ID":"11a9f890-ef52-45fd-88e3-2fadb709e8df","Type":"ContainerStarted","Data":"42acfcd3790d1904b418cee562ca37122b9f1a6f8ddc16cbde68ab4e763e0ebb"} Jul 07 15:14:30.864496 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:30.864134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2426" event={"ID":"11a9f890-ef52-45fd-88e3-2fadb709e8df","Type":"ContainerStarted","Data":"c685521b0f558dbf3fe2d2240c01ad6e7dd56eb44b14f0fc6eb4fea328661453"} Jul 07 15:14:30.886218 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:30.886169 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r2426" podStartSLOduration=2.616026505 podStartE2EDuration="3.886155882s" totalImagesPullingTime="1.20845535s" totalInitContainerRuntime="61.674027ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:30.885112021 +0000 UTC m=+90.993507148" watchObservedRunningTime="2026-07-07 15:14:30.886155882 +0000 UTC m=+90.994551008" Jul 07 15:14:31.166438 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:31.166321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:31.228091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:31.228060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:31.469972 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:31.469875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:31.571294 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:31.571264 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:32.179287 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.179241 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:32.193509 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.193484 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr"] Jul 07 15:14:32.196424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.196409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.198689 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.198671 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 15:14:32.198689 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.198688 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pdh69\"" Jul 07 15:14:32.205664 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.205644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr"] Jul 07 15:14:32.249364 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.249322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:32.313784 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.313751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m299v\" (UniqueName: \"kubernetes.io/projected/383ab718-a299-44d0-906d-09c3cd3014ae-kube-api-access-m299v\") pod \"monitoring-plugin-d5dcff7cf-46qbr\" (UID: \"383ab718-a299-44d0-906d-09c3cd3014ae\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.313966 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.313796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/383ab718-a299-44d0-906d-09c3cd3014ae-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-46qbr\" (UID: \"383ab718-a299-44d0-906d-09c3cd3014ae\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.316657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.316636 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:32.414668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.414634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/383ab718-a299-44d0-906d-09c3cd3014ae-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-46qbr\" (UID: \"383ab718-a299-44d0-906d-09c3cd3014ae\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.414811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.414692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m299v\" (UniqueName: \"kubernetes.io/projected/383ab718-a299-44d0-906d-09c3cd3014ae-kube-api-access-m299v\") pod \"monitoring-plugin-d5dcff7cf-46qbr\" (UID: \"383ab718-a299-44d0-906d-09c3cd3014ae\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.417070 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.417048 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/383ab718-a299-44d0-906d-09c3cd3014ae-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-46qbr\" (UID: \"383ab718-a299-44d0-906d-09c3cd3014ae\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.423560 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.423531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m299v\" (UniqueName: \"kubernetes.io/projected/383ab718-a299-44d0-906d-09c3cd3014ae-kube-api-access-m299v\") pod \"monitoring-plugin-d5dcff7cf-46qbr\" (UID: \"383ab718-a299-44d0-906d-09c3cd3014ae\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.505867 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.505770 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:32.627189 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.627155 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr"] Jul 07 15:14:32.630115 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:14:32.630088 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383ab718_a299_44d0_906d_09c3cd3014ae.slice/crio-655bad307ec9e3ccac00749f079ef2eeecc4e93cf17d442597077bb659f63b4c WatchSource:0}: Error finding container 655bad307ec9e3ccac00749f079ef2eeecc4e93cf17d442597077bb659f63b4c: Status 404 returned error can't find the container with id 655bad307ec9e3ccac00749f079ef2eeecc4e93cf17d442597077bb659f63b4c Jul 07 15:14:32.871431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.871389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" event={"ID":"383ab718-a299-44d0-906d-09c3cd3014ae","Type":"ContainerStarted","Data":"655bad307ec9e3ccac00749f079ef2eeecc4e93cf17d442597077bb659f63b4c"} Jul 07 15:14:32.941237 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:32.941204 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:33.043217 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:33.043186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:33.792283 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:33.792245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:33.949404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:33.949365 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:34.880220 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:34.880186 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" event={"ID":"383ab718-a299-44d0-906d-09c3cd3014ae","Type":"ContainerStarted","Data":"0c1a3f2f1ecdcf93456cd0cbb9261c62dbe008f1ab2793643fb0a3a00eb13a55"} Jul 07 15:14:34.880679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:34.880424 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:34.885027 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:34.885005 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" Jul 07 15:14:34.897737 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:34.897696 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-46qbr" podStartSLOduration=1.349175818 podStartE2EDuration="2.897681132s" totalImagesPullingTime="1.548505314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:34.89687769 +0000 UTC m=+95.005272817" watchObservedRunningTime="2026-07-07 15:14:34.897681132 +0000 UTC m=+95.006076280" Jul 07 15:14:35.804464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:35.804434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b7d56df6c-bkzqw" Jul 07 15:14:35.998196 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:35.998165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:36.079433 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:36.079356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:38.919050 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:38.919012 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:39.028634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:39.028608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:41.223251 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:41.223221 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:41.313342 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:41.313309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:42.064158 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:42.064115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:42.150649 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:42.150619 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:42.314200 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:42.314116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:42.405234 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:42.405181 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:44.794813 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:44.794788 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jslxj" Jul 07 15:14:48.030252 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:48.030218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:48.134421 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:48.134395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:49.938624 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:49.938591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:50.091380 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:50.091339 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:51.581764 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:51.581732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:51.653440 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:51.653405 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:53.101147 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:53.101115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:55.386322 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:55.386289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:55.488210 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:14:55.488185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:02.115242 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:02.115208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:02.263567 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:02.263536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:02.359668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:02.359639 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:05.063632 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:05.063578 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:10.394037 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:10.394003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:10.463008 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:10.462976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:46.903393 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:46.903360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:47.284076 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:47.284049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:56.193356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:56.193260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:56.276145 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:56.276117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:57.431134 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:15:57.431089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:06.651685 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:16:06.651645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:06.714711 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:16:06.714679 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:06.776567 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:16:06.776540 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:49.228409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:16:49.228370 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:49.318526 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:16:49.318485 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:54.404234 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:16:54.404203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:16.418384 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:16.418351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:21.174449 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:21.174412 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:21.249335 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:21.249302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:29.200609 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:29.200522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:29.307200 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:29.307171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:32.794823 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:32.794778 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:32.867334 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:32.867297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:40.097312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:40.097271 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:40.204138 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:40.204103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:40.282811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:40.282777 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:40.399820 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:40.399738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:41.137955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:41.137919 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:41.211858 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:17:41.211805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:01.352777 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:01.352745 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:18:02.251032 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.250994 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:02.343486 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.343451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:02.993286 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.993249 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv"] Jul 07 15:18:02.996362 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.996345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:02.998576 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.998553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 15:18:02.999427 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.999409 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 15:18:02.999513 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:02.999457 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5kvd6\"" Jul 07 15:18:03.005991 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.005972 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv"] Jul 07 15:18:03.051329 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.051301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.051484 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.051341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2scxk\" (UniqueName: \"kubernetes.io/projected/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-kube-api-access-2scxk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.051484 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.051384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.152572 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.152544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.152678 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.152582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.152678 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.152632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2scxk\" (UniqueName: \"kubernetes.io/projected/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-kube-api-access-2scxk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.153048 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.153029 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.153088 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.153038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.161185 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.161163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2scxk\" (UniqueName: \"kubernetes.io/projected/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-kube-api-access-2scxk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.305455 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.305424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:03.429439 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.429290 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv"] Jul 07 15:18:03.431898 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:18:03.431868 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903542d3_35a1_4d6e_a2f3_b0fce1fdc11b.slice/crio-6989f232315009e441e7367f7255c6c8aa32321422844f6ea1b0f435e0bfe5b5 WatchSource:0}: Error finding container 6989f232315009e441e7367f7255c6c8aa32321422844f6ea1b0f435e0bfe5b5: Status 404 returned error can't find the container with id 6989f232315009e441e7367f7255c6c8aa32321422844f6ea1b0f435e0bfe5b5 Jul 07 15:18:03.433720 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.433705 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:18:03.550867 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:03.550816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" event={"ID":"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b","Type":"ContainerStarted","Data":"6989f232315009e441e7367f7255c6c8aa32321422844f6ea1b0f435e0bfe5b5"} Jul 07 15:18:09.573803 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:09.573765 2564 generic.go:356] "Generic (PLEG): container finished" podID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerID="43f125a3728f0a15f7af8f28b4e51c759a5d34f78717408931c4a9c7a6b1342f" exitCode=0 Jul 07 15:18:09.574168 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:09.573820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" event={"ID":"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b","Type":"ContainerDied","Data":"43f125a3728f0a15f7af8f28b4e51c759a5d34f78717408931c4a9c7a6b1342f"} Jul 07 15:18:11.582093 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:11.582059 2564 generic.go:356] "Generic (PLEG): container finished" podID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerID="558011db483a568e44b952617ce8b12eeabf7fdaaa1e595ca06054eb0323c942" exitCode=0 Jul 07 15:18:11.582460 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:11.582137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" event={"ID":"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b","Type":"ContainerDied","Data":"558011db483a568e44b952617ce8b12eeabf7fdaaa1e595ca06054eb0323c942"} Jul 07 15:18:22.622707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:22.622620 2564 generic.go:356] "Generic (PLEG): container finished" podID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerID="c460a4f27b4b2338889611476d470e46acb5c2db38cfc7ef9e7e18b6b1742c97" exitCode=0 Jul 07 15:18:22.622707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:22.622695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" event={"ID":"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b","Type":"ContainerDied","Data":"c460a4f27b4b2338889611476d470e46acb5c2db38cfc7ef9e7e18b6b1742c97"} Jul 07 15:18:23.746064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.746041 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:23.910039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.909945 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2scxk\" (UniqueName: \"kubernetes.io/projected/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-kube-api-access-2scxk\") pod \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " Jul 07 15:18:23.910039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.909982 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-bundle\") pod \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " Jul 07 15:18:23.910039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.910014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-util\") pod \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\" (UID: \"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b\") " Jul 07 15:18:23.910816 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.910781 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-bundle" (OuterVolumeSpecName: "bundle") pod "903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" (UID: "903542d3-35a1-4d6e-a2f3-b0fce1fdc11b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:18:23.912139 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.912110 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-kube-api-access-2scxk" (OuterVolumeSpecName: "kube-api-access-2scxk") pod "903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" (UID: "903542d3-35a1-4d6e-a2f3-b0fce1fdc11b"). InnerVolumeSpecName "kube-api-access-2scxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:18:23.914477 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:23.914458 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-util" (OuterVolumeSpecName: "util") pod "903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" (UID: "903542d3-35a1-4d6e-a2f3-b0fce1fdc11b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:18:24.010633 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:24.010598 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2scxk\" (UniqueName: \"kubernetes.io/projected/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-kube-api-access-2scxk\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:18:24.010633 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:24.010628 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-bundle\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:18:24.010633 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:24.010639 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/903542d3-35a1-4d6e-a2f3-b0fce1fdc11b-util\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:18:24.630950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:24.630920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" event={"ID":"903542d3-35a1-4d6e-a2f3-b0fce1fdc11b","Type":"ContainerDied","Data":"6989f232315009e441e7367f7255c6c8aa32321422844f6ea1b0f435e0bfe5b5"} Jul 07 15:18:24.630950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:24.630953 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lpglv" Jul 07 15:18:24.631139 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:24.630967 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6989f232315009e441e7367f7255c6c8aa32321422844f6ea1b0f435e0bfe5b5" Jul 07 15:18:29.150276 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:29.150235 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:31.150973 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:31.150940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:32.928717 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:32.928662 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:33.031244 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:33.031193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:34.980282 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:34.980245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:35.081323 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:35.081297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:35.552509 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:35.552482 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:35.670279 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:35.670251 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:37.068339 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:37.068309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:37.263064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:37.263025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:38.279170 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279135 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k"] Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279353 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="extract" Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279363 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="extract" Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279376 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="pull" Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279381 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="pull" Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279394 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="util" Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279400 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="util" Jul 07 15:18:38.279538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.279443 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="903542d3-35a1-4d6e-a2f3-b0fce1fdc11b" containerName="extract" Jul 07 15:18:38.282778 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.282760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.285313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.285289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2c2cp\"" Jul 07 15:18:38.286201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.286184 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 15:18:38.286281 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.286224 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 15:18:38.291739 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.291719 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k"] Jul 07 15:18:38.404847 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.404766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d133d4b0-fb09-431f-a6fc-5330767945de-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fcs9k\" (UID: \"d133d4b0-fb09-431f-a6fc-5330767945de\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.404847 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.404818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2xg\" (UniqueName: \"kubernetes.io/projected/d133d4b0-fb09-431f-a6fc-5330767945de-kube-api-access-2h2xg\") pod \"cert-manager-cainjector-559cdd8c87-fcs9k\" (UID: \"d133d4b0-fb09-431f-a6fc-5330767945de\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.506121 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.506074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d133d4b0-fb09-431f-a6fc-5330767945de-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fcs9k\" (UID: \"d133d4b0-fb09-431f-a6fc-5330767945de\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.506121 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.506125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2xg\" (UniqueName: \"kubernetes.io/projected/d133d4b0-fb09-431f-a6fc-5330767945de-kube-api-access-2h2xg\") pod \"cert-manager-cainjector-559cdd8c87-fcs9k\" (UID: \"d133d4b0-fb09-431f-a6fc-5330767945de\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.515187 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.515164 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d133d4b0-fb09-431f-a6fc-5330767945de-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fcs9k\" (UID: \"d133d4b0-fb09-431f-a6fc-5330767945de\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.515355 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.515334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2xg\" (UniqueName: \"kubernetes.io/projected/d133d4b0-fb09-431f-a6fc-5330767945de-kube-api-access-2h2xg\") pod \"cert-manager-cainjector-559cdd8c87-fcs9k\" (UID: \"d133d4b0-fb09-431f-a6fc-5330767945de\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.591965 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.591886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" Jul 07 15:18:38.721937 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:38.721915 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k"] Jul 07 15:18:38.724133 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:18:38.724104 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd133d4b0_fb09_431f_a6fc_5330767945de.slice/crio-5661f19f65c3e0c1c5c78d2382e2b84d5353c13afefae120239727f120c600d1 WatchSource:0}: Error finding container 5661f19f65c3e0c1c5c78d2382e2b84d5353c13afefae120239727f120c600d1: Status 404 returned error can't find the container with id 5661f19f65c3e0c1c5c78d2382e2b84d5353c13afefae120239727f120c600d1 Jul 07 15:18:39.682312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:39.682272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" event={"ID":"d133d4b0-fb09-431f-a6fc-5330767945de","Type":"ContainerStarted","Data":"5661f19f65c3e0c1c5c78d2382e2b84d5353c13afefae120239727f120c600d1"} Jul 07 15:18:39.947585 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:39.947468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:40.050536 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:40.050503 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:41.691893 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:41.691790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" event={"ID":"d133d4b0-fb09-431f-a6fc-5330767945de","Type":"ContainerStarted","Data":"1aa139dc5a019b4742ef24de844d2c69e9729d0efb4a544747cf376cd93d5092"} Jul 07 15:18:41.713216 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:41.713165 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcs9k" podStartSLOduration=1.003696309 podStartE2EDuration="3.713149199s" totalImagesPullingTime="2.70945289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:18:41.712446263 +0000 UTC m=+341.820841390" watchObservedRunningTime="2026-07-07 15:18:41.713149199 +0000 UTC m=+341.821544325" Jul 07 15:18:45.477771 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:45.477733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:47.449968 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:47.449941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:47.576150 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:18:47.576117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:02.152304 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:02.152228 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:02.245422 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:02.245388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:07.211213 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:07.211167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:07.312118 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:07.312079 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:09.407975 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:09.407944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:13.553021 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.552986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:13.630457 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.630425 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6"] Jul 07 15:19:13.633340 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.633326 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.636958 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.636937 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 15:19:13.637078 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.636997 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 15:19:13.637078 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.637045 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:19:13.637078 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.637068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 15:19:13.637239 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.637072 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rt5bv\"" Jul 07 15:19:13.637239 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.637119 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 15:19:13.652222 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.652201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcbff\" (UniqueName: \"kubernetes.io/projected/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-kube-api-access-tcbff\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.652307 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.652244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-cert\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.652307 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.652277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-manager-config\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.652307 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.652304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-metrics-cert\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.656603 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.656565 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6"] Jul 07 15:19:13.659020 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.659000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:13.753369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.753337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-manager-config\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.753369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.753367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-metrics-cert\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.753605 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.753388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcbff\" (UniqueName: \"kubernetes.io/projected/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-kube-api-access-tcbff\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.753605 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.753428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-cert\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.754073 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.754051 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-manager-config\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.755911 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.755888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-metrics-cert\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.755911 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.755901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-cert\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.763984 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.763964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcbff\" (UniqueName: \"kubernetes.io/projected/e63b747e-cd54-4134-bf7d-1d4be4c2ea2c-kube-api-access-tcbff\") pod \"lws-controller-manager-5ffd868d8b-52qm6\" (UID: \"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c\") " pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:13.942444 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:13.942362 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:14.080592 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:14.080553 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6"] Jul 07 15:19:14.083316 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:19:14.083289 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63b747e_cd54_4134_bf7d_1d4be4c2ea2c.slice/crio-210d932d7f30666db000c6183836f43125d6616f0ad5522a5c773face80532a3 WatchSource:0}: Error finding container 210d932d7f30666db000c6183836f43125d6616f0ad5522a5c773face80532a3: Status 404 returned error can't find the container with id 210d932d7f30666db000c6183836f43125d6616f0ad5522a5c773face80532a3 Jul 07 15:19:14.799692 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:14.799657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" event={"ID":"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c","Type":"ContainerStarted","Data":"210d932d7f30666db000c6183836f43125d6616f0ad5522a5c773face80532a3"} Jul 07 15:19:16.808869 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:16.808818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" event={"ID":"e63b747e-cd54-4134-bf7d-1d4be4c2ea2c","Type":"ContainerStarted","Data":"d037dbc73df54494b6b21ee3e1e9cd37a191ce08e879864ba45f06410cfea227"} Jul 07 15:19:16.809276 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:16.808944 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:16.828180 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:16.828134 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" podStartSLOduration=1.52738353 podStartE2EDuration="3.828119963s" totalImagesPullingTime="2.300736433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:19:16.82675459 +0000 UTC m=+376.935149728" watchObservedRunningTime="2026-07-07 15:19:16.828119963 +0000 UTC m=+376.936515089" Jul 07 15:19:27.814677 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:27.814648 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ffd868d8b-52qm6" Jul 07 15:19:37.253340 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.253309 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8"] Jul 07 15:19:37.256158 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.256142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.261126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.261103 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 15:19:37.261275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.261258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 15:19:37.261376 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.261359 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 15:19:37.261672 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.261652 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rcsvm\"" Jul 07 15:19:37.261921 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.261902 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 15:19:37.279375 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.279354 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8"] Jul 07 15:19:37.318702 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.318678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2c9a3e6-9723-47af-95dc-e6c584662dac-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.318804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.318712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2c9a3e6-9723-47af-95dc-e6c584662dac-tmp\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.318804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.318740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2c9a3e6-9723-47af-95dc-e6c584662dac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.318804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.318782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2c9a3e6-9723-47af-95dc-e6c584662dac-manifests\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.318945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.318849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8lbm\" (UniqueName: \"kubernetes.io/projected/a2c9a3e6-9723-47af-95dc-e6c584662dac-kube-api-access-d8lbm\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.420046 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.420014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8lbm\" (UniqueName: \"kubernetes.io/projected/a2c9a3e6-9723-47af-95dc-e6c584662dac-kube-api-access-d8lbm\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.420187 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.420054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2c9a3e6-9723-47af-95dc-e6c584662dac-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.420187 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.420078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2c9a3e6-9723-47af-95dc-e6c584662dac-tmp\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.420259 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.420195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2c9a3e6-9723-47af-95dc-e6c584662dac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.420259 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.420236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2c9a3e6-9723-47af-95dc-e6c584662dac-manifests\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.420599 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.420567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2c9a3e6-9723-47af-95dc-e6c584662dac-manifests\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.422327 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.422300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2c9a3e6-9723-47af-95dc-e6c584662dac-tmp\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.422569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.422549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2c9a3e6-9723-47af-95dc-e6c584662dac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.422635 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.422571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2c9a3e6-9723-47af-95dc-e6c584662dac-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.430228 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.430206 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8lbm\" (UniqueName: \"kubernetes.io/projected/a2c9a3e6-9723-47af-95dc-e6c584662dac-kube-api-access-d8lbm\") pod \"opendatahub-operator-controller-manager-dcbf69668-pgln8\" (UID: \"a2c9a3e6-9723-47af-95dc-e6c584662dac\") " pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.486712 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.486679 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:37.566246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.566218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:37.587884 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.587859 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:37.707736 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.707699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:37.712131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.712108 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8"] Jul 07 15:19:37.714955 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:19:37.714932 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c9a3e6_9723_47af_95dc_e6c584662dac.slice/crio-3f56e5506a3a86ac029e77c15baef445f6914fd8d80e61b987f86d5a6f663489 WatchSource:0}: Error finding container 3f56e5506a3a86ac029e77c15baef445f6914fd8d80e61b987f86d5a6f663489: Status 404 returned error can't find the container with id 3f56e5506a3a86ac029e77c15baef445f6914fd8d80e61b987f86d5a6f663489 Jul 07 15:19:37.795234 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.795208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:37.882204 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:37.882116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" event={"ID":"a2c9a3e6-9723-47af-95dc-e6c584662dac","Type":"ContainerStarted","Data":"3f56e5506a3a86ac029e77c15baef445f6914fd8d80e61b987f86d5a6f663489"} Jul 07 15:19:38.193634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:38.193548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:42.907229 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:42.907190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" event={"ID":"a2c9a3e6-9723-47af-95dc-e6c584662dac","Type":"ContainerStarted","Data":"8ab7cbcc03477ae4d5e5df91fd936906400a8281d184426727720aa0c0d641f3"} Jul 07 15:19:43.911821 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:43.911786 2564 generic.go:356] "Generic (PLEG): container finished" podID="a2c9a3e6-9723-47af-95dc-e6c584662dac" containerID="8ab7cbcc03477ae4d5e5df91fd936906400a8281d184426727720aa0c0d641f3" exitCode=0 Jul 07 15:19:43.911821 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:43.911823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" event={"ID":"a2c9a3e6-9723-47af-95dc-e6c584662dac","Type":"ContainerDied","Data":"8ab7cbcc03477ae4d5e5df91fd936906400a8281d184426727720aa0c0d641f3"} Jul 07 15:19:44.916668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:44.916633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" event={"ID":"a2c9a3e6-9723-47af-95dc-e6c584662dac","Type":"ContainerStarted","Data":"18f6331e9566c905bea740fe6d14029b84b125b710edeeeacb8e20c8330ce374"} Jul 07 15:19:44.917061 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:44.916752 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:44.943554 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:44.943508 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" podStartSLOduration=2.27894011 podStartE2EDuration="7.943492145s" totalImagesPullingTime="4.644546974s" totalInitContainerRuntime="1.020005061s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:19:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:19:44.942565263 +0000 UTC m=+405.050960391" watchObservedRunningTime="2026-07-07 15:19:44.943492145 +0000 UTC m=+405.051887268" Jul 07 15:19:55.923261 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:55.923228 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dcbf69668-pgln8" Jul 07 15:19:57.837012 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:57.836985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:58.027649 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:58.027615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:58.612709 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:58.612676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:59.039786 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:59.039756 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:59.145099 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:59.145067 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:59.248122 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:59.248088 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:59.437148 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:59.437063 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:59.991810 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:19:59.991775 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:00.092165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:00.092130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:00.201144 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:00.201112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:00.283497 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:00.283465 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:01.564332 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:01.564297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:06.878347 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:06.878309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:06.995471 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:06.995436 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:07.960201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.960170 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx"] Jul 07 15:20:07.965123 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.965106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:07.967797 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.967774 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 15:20:07.967982 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.967894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 15:20:07.968037 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.968028 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-92swf\"" Jul 07 15:20:07.968821 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.968798 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 15:20:07.972717 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.972698 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7"] Jul 07 15:20:07.975540 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.975525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:07.983287 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.983266 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx"] Jul 07 15:20:07.983713 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.983697 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 15:20:07.984018 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.983987 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 15:20:07.984123 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.984052 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z58x7\"" Jul 07 15:20:07.988892 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:07.988873 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 15:20:08.001769 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.001741 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7"] Jul 07 15:20:08.026744 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.026714 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:08.052019 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.051974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r7jv\" (UniqueName: \"kubernetes.io/projected/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-kube-api-access-7r7jv\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.052545 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.052275 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.101076 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.101046 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:08.152843 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.152807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153012 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.152865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153012 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.152933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153012 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.152983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf4hn\" (UniqueName: \"kubernetes.io/projected/fe9a0d3c-587b-4774-acc2-5465e7377f5f-kube-api-access-jf4hn\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r7jv\" (UniqueName: \"kubernetes.io/projected/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-kube-api-access-7r7jv\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153169 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9a0d3c-587b-4774-acc2-5465e7377f5f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153383 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153633 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.153982 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.153965 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.155355 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.155335 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.155720 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.155702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.164389 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.164366 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.165388 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.165371 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r7jv\" (UniqueName: \"kubernetes.io/projected/f0e3dfc4-7e6a-4715-ab92-2c4278ea068a-kube-api-access-7r7jv\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784wswx\" (UID: \"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.254481 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.254481 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.254481 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9a0d3c-587b-4774-acc2-5465e7377f5f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.254752 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.254752 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.254752 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf4hn\" (UniqueName: \"kubernetes.io/projected/fe9a0d3c-587b-4774-acc2-5465e7377f5f-kube-api-access-jf4hn\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.254752 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.254574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.255316 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.255289 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.256987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.256962 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.256987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.256975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9a0d3c-587b-4774-acc2-5465e7377f5f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.256987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.256964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.257194 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.257040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.271234 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.271213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9a0d3c-587b-4774-acc2-5465e7377f5f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.275192 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.275176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:08.276710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.276686 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:08.277571 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.277553 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf4hn\" (UniqueName: \"kubernetes.io/projected/fe9a0d3c-587b-4774-acc2-5465e7377f5f-kube-api-access-jf4hn\") pod \"istiod-openshift-gateway-94bb8fbfd-fxcb7\" (UID: \"fe9a0d3c-587b-4774-acc2-5465e7377f5f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.284541 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.284525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:08.458487 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.458458 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx"] Jul 07 15:20:08.461379 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:20:08.461353 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e3dfc4_7e6a_4715_ab92_2c4278ea068a.slice/crio-3ef58f1cdf402c036449696e918d4d054bcb8a4f82c9d542194c00168a31416f WatchSource:0}: Error finding container 3ef58f1cdf402c036449696e918d4d054bcb8a4f82c9d542194c00168a31416f: Status 404 returned error can't find the container with id 3ef58f1cdf402c036449696e918d4d054bcb8a4f82c9d542194c00168a31416f Jul 07 15:20:08.505307 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:20:08.505246 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9a0d3c_587b_4774_acc2_5465e7377f5f.slice/crio-7e529e25ddfb31e1ebe4f7c4787df14d1d9af4c750f94e8df6d6d81606442300 WatchSource:0}: Error finding container 7e529e25ddfb31e1ebe4f7c4787df14d1d9af4c750f94e8df6d6d81606442300: Status 404 returned error can't find the container with id 7e529e25ddfb31e1ebe4f7c4787df14d1d9af4c750f94e8df6d6d81606442300 Jul 07 15:20:08.513883 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:08.513861 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7"] Jul 07 15:20:09.010871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:09.010813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" event={"ID":"fe9a0d3c-587b-4774-acc2-5465e7377f5f","Type":"ContainerStarted","Data":"7e529e25ddfb31e1ebe4f7c4787df14d1d9af4c750f94e8df6d6d81606442300"} Jul 07 15:20:09.013806 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:09.013775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" event={"ID":"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a","Type":"ContainerStarted","Data":"3ef58f1cdf402c036449696e918d4d054bcb8a4f82c9d542194c00168a31416f"} Jul 07 15:20:12.062785 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.062747 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:20:12.063152 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.062822 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:20:12.069362 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.069335 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:20:12.069510 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.069403 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:20:12.069510 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.069449 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:20:12.341006 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.340927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:12.518770 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.518736 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:12.593051 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:12.592976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:13.007163 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.007080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:13.031524 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.031478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" event={"ID":"fe9a0d3c-587b-4774-acc2-5465e7377f5f","Type":"ContainerStarted","Data":"3359d220ccc7eacac6ecd26bfdd0a646b549d2b03c90265969424ed86f978696"} Jul 07 15:20:13.031736 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.031716 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:13.033306 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.033267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" event={"ID":"f0e3dfc4-7e6a-4715-ab92-2c4278ea068a","Type":"ContainerStarted","Data":"8cb1510867071974b875e958bb36afdb50d3b8c5df7cf994d74f62e210717e42"} Jul 07 15:20:13.033603 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.033576 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-fxcb7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 15:20:13.033674 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.033639 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" podUID="fe9a0d3c-587b-4774-acc2-5465e7377f5f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:20:13.112885 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.112808 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" podStartSLOduration=2.557469254 podStartE2EDuration="6.112791701s" totalImagesPullingTime="3.555322447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:20:13.101563059 +0000 UTC m=+433.209958185" watchObservedRunningTime="2026-07-07 15:20:13.112791701 +0000 UTC m=+433.221186827" Jul 07 15:20:13.157713 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.157640 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" podStartSLOduration=2.551827917 podStartE2EDuration="6.157617088s" totalImagesPullingTime="3.605789171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:20:13.157039348 +0000 UTC m=+433.265434475" watchObservedRunningTime="2026-07-07 15:20:13.157617088 +0000 UTC m=+433.266012216" Jul 07 15:20:13.275900 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.275867 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:13.280173 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.280154 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:13.858984 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.858951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:13.965964 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:13.965919 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:14.042054 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:14.042026 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:14.042772 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:14.042750 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fxcb7" Jul 07 15:20:14.042915 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:14.042897 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784wswx" Jul 07 15:20:18.591327 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:18.591289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:59.212868 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:59.212802 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:59.312007 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:59.311970 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:59.447988 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:20:59.447956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:00.149160 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:00.149126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:00.348093 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:00.348054 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:05.133014 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:05.132974 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:14.287313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:14.287278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:14.365392 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:14.365361 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:14.686091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:14.685974 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:14.786223 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:14.786191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:16.647870 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:16.647800 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:16.731212 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:16.731174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:22.590995 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:22.590961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:26.286031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:26.285997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:28.549116 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:28.549068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:29.596364 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:29.596320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:29.836019 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:29.835990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:30.013791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:30.013667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:33.203599 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:33.203555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:33.447932 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:33.447890 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:33.542952 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:33.542915 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:36.420211 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:36.420181 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:36.658414 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:36.658375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:36.759751 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:36.759654 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:37.598081 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:37.598054 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:37.701537 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:37.701500 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:44.797419 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:44.797375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:44.913969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:44.913932 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:50.613427 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:50.613373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:50.717773 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:50.717729 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:53.602690 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:53.602610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:53.704028 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:53.703995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:57.418422 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:57.418358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:21:57.520031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:21:57.519999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:03.810746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:03.810712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:03.909571 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:03.909543 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:10.364297 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:10.364263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:10.464546 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:10.464517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:13.366150 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:13.366116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:13.467346 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:13.467315 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:17.396813 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:17.396777 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:17.495408 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:17.495376 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:18.774950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:18.774919 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:25.163731 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:25.163687 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:25.263445 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:25.263409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:28.950276 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:28.950242 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n"] Jul 07 15:22:28.953341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:28.953323 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:28.955785 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:28.955757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xsp66\"" Jul 07 15:22:28.966246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:28.966218 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n"] Jul 07 15:22:28.990027 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:28.990000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:29.010074 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010184 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010184 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010295 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010295 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010406 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsfr\" (UniqueName: \"kubernetes.io/projected/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-kube-api-access-cmsfr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010406 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010406 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.010516 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.010423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111137 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111137 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsfr\" (UniqueName: \"kubernetes.io/projected/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-kube-api-access-cmsfr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111735 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111735 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111652 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111880 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.111880 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.112013 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.111990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.113543 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.113521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.113968 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.113951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.121160 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.121139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.121160 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.121154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsfr\" (UniqueName: \"kubernetes.io/projected/eda5f1fc-5d79-4e3c-9b08-a5c120490c8f-kube-api-access-cmsfr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-k4s6n\" (UID: \"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.263769 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.263686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:29.348998 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.348927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:29.397465 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.397428 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n"] Jul 07 15:22:29.399365 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:22:29.399338 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda5f1fc_5d79_4e3c_9b08_a5c120490c8f.slice/crio-1bab087281c9bb51e85258c87314620864e99f5d7499c17b1fcac0f4e7682c2d WatchSource:0}: Error finding container 1bab087281c9bb51e85258c87314620864e99f5d7499c17b1fcac0f4e7682c2d: Status 404 returned error can't find the container with id 1bab087281c9bb51e85258c87314620864e99f5d7499c17b1fcac0f4e7682c2d Jul 07 15:22:29.401358 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.401333 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:22:29.401425 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.401392 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:22:29.401425 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.401418 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:22:29.557733 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.557702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" event={"ID":"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f","Type":"ContainerStarted","Data":"b9f8dbd9d9846a2f7f831584cbf4fb0e6a4fa009d709be26d2b47c806aafc592"} Jul 07 15:22:29.557916 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.557751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" event={"ID":"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f","Type":"ContainerStarted","Data":"1bab087281c9bb51e85258c87314620864e99f5d7499c17b1fcac0f4e7682c2d"} Jul 07 15:22:29.580746 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:29.580693 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" podStartSLOduration=1.580676814 podStartE2EDuration="1.580676814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:22:29.578784704 +0000 UTC m=+569.687179843" watchObservedRunningTime="2026-07-07 15:22:29.580676814 +0000 UTC m=+569.689071987" Jul 07 15:22:30.264117 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.264088 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:30.268614 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.268592 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:30.562251 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.562224 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:30.563008 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.562992 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:22:30.660429 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.660387 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:30.805051 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.805016 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:30.903382 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:30.903288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:31.789628 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:31.789591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:32.145184 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:32.145103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:33.793674 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:33.793641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:33.896636 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:33.896602 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:47.318193 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:47.318152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:51.794550 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:51.794514 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:59.933161 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:22:59.933125 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:00.461952 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:00.461915 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:03.425517 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:03.425475 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:03.526872 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:03.526813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:09.416181 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:09.416137 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:09.516872 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:09.516809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:09.594321 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:09.594282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:09.908815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:09.908782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:13.140322 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:13.140293 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:13.233100 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:13.233069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:45.119483 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:45.119445 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:46.877437 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:46.877402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:53.888314 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:53.888279 2564 generic.go:356] "Generic (PLEG): container finished" podID="eda5f1fc-5d79-4e3c-9b08-a5c120490c8f" containerID="b9f8dbd9d9846a2f7f831584cbf4fb0e6a4fa009d709be26d2b47c806aafc592" exitCode=0 Jul 07 15:23:53.888883 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:53.888357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" event={"ID":"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f","Type":"ContainerDied","Data":"b9f8dbd9d9846a2f7f831584cbf4fb0e6a4fa009d709be26d2b47c806aafc592"} Jul 07 15:23:53.888883 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:53.888845 2564 scope.go:117] "RemoveContainer" containerID="b9f8dbd9d9846a2f7f831584cbf4fb0e6a4fa009d709be26d2b47c806aafc592" Jul 07 15:23:53.889910 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:53.889885 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:23:53.889987 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:53.889950 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:23:53.890026 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:53.889992 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:23:54.894135 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:54.894102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" event={"ID":"eda5f1fc-5d79-4e3c-9b08-a5c120490c8f","Type":"ContainerStarted","Data":"8087f3e39eebfea6f8d9b85fe580080183ba1300a506cfbd23f341e64b3d142b"} Jul 07 15:23:55.264949 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:55.264843 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:23:55.265087 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:55.265022 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-k4s6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" start-of-body= Jul 07 15:23:55.265127 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:55.265079 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" podUID="eda5f1fc-5d79-4e3c-9b08-a5c120490c8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" Jul 07 15:23:55.897543 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:55.897516 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:56.009964 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:56.009933 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:56.265125 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:56.265030 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-k4s6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" start-of-body= Jul 07 15:23:56.265125 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:56.265091 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" podUID="eda5f1fc-5d79-4e3c-9b08-a5c120490c8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" Jul 07 15:23:57.264615 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:57.264575 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-k4s6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" start-of-body= Jul 07 15:23:57.265027 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:57.264642 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" podUID="eda5f1fc-5d79-4e3c-9b08-a5c120490c8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" Jul 07 15:23:57.912294 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:57.912261 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:58.013371 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:58.013340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:58.264983 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:58.264893 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-k4s6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" start-of-body= Jul 07 15:23:58.264983 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:58.264944 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" podUID="eda5f1fc-5d79-4e3c-9b08-a5c120490c8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.19:15021/healthz/ready\": dial tcp 10.132.0.19:15021: connect: connection refused" Jul 07 15:23:59.267784 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:59.267758 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:23:59.268154 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:59.268141 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:23:59.268744 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:23:59.268725 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-k4s6n" Jul 07 15:24:05.077229 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:05.077195 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:11.637722 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.637691 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl"] Jul 07 15:24:11.641073 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.641052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.643821 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.643799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 15:24:11.643960 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.643945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 15:24:11.644872 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.644856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6kqtt\"" Jul 07 15:24:11.644986 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.644864 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 15:24:11.652969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.652946 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl"] Jul 07 15:24:11.681969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.681934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:11.772357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.772315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4vc\" (UniqueName: \"kubernetes.io/projected/92e14013-0b71-447b-8239-ed473212a478-kube-api-access-nw4vc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.772357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.772356 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.772626 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.772392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.772626 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.772435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.772626 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.772523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e14013-0b71-447b-8239-ed473212a478-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.772626 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.772559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873438 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873438 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4vc\" (UniqueName: \"kubernetes.io/projected/92e14013-0b71-447b-8239-ed473212a478-kube-api-access-nw4vc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e14013-0b71-447b-8239-ed473212a478-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.873955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.874012 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.874048 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.873999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.875795 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.875774 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e14013-0b71-447b-8239-ed473212a478-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.876050 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.876034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e14013-0b71-447b-8239-ed473212a478-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.881898 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.881877 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4vc\" (UniqueName: \"kubernetes.io/projected/92e14013-0b71-447b-8239-ed473212a478-kube-api-access-nw4vc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l9mbl\" (UID: \"92e14013-0b71-447b-8239-ed473212a478\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:11.950942 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:11.950846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:12.084660 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:12.084630 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl"] Jul 07 15:24:12.086046 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:24:12.086016 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e14013_0b71_447b_8239_ed473212a478.slice/crio-cebd591571b9d2297dd264e7f2c4487f9a81878b74ecaf5c3869aaebd8b609b4 WatchSource:0}: Error finding container cebd591571b9d2297dd264e7f2c4487f9a81878b74ecaf5c3869aaebd8b609b4: Status 404 returned error can't find the container with id cebd591571b9d2297dd264e7f2c4487f9a81878b74ecaf5c3869aaebd8b609b4 Jul 07 15:24:12.087560 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:12.087539 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:24:12.964622 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:12.964576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" event={"ID":"92e14013-0b71-447b-8239-ed473212a478","Type":"ContainerStarted","Data":"cebd591571b9d2297dd264e7f2c4487f9a81878b74ecaf5c3869aaebd8b609b4"} Jul 07 15:24:13.970049 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:13.970009 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" event={"ID":"92e14013-0b71-447b-8239-ed473212a478","Type":"ContainerStarted","Data":"b7ec39da6edb6aebb00326d00bdd0678db640b7db3fe6893b2e3a16ced0edca8"} Jul 07 15:24:13.990011 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:13.989966 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" podStartSLOduration=1.8919504649999999 podStartE2EDuration="2.989950236s" totalImagesPullingTime="1.097999771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:24:13.988203222 +0000 UTC m=+674.096598348" watchObservedRunningTime="2026-07-07 15:24:13.989950236 +0000 UTC m=+674.098345361" Jul 07 15:24:21.952009 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:21.951972 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:21.952500 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:21.952045 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:21.964367 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:21.964302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:22.011096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:22.011065 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l9mbl" Jul 07 15:24:30.054935 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:30.054902 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:36.767064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:36.767030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:51.509998 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:51.509958 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:51.716400 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:51.716368 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:51.818530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:51.818501 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:52.442718 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.442686 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4"] Jul 07 15:24:52.447664 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.447647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.450081 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.450060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 15:24:52.459025 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.459001 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4"] Jul 07 15:24:52.500533 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.500503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.500679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.500549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbkzq\" (UniqueName: \"kubernetes.io/projected/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-kube-api-access-mbkzq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.500679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.500621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.500762 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.500680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.500762 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.500727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.500884 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.500864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.563068 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.563006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:24:52.601286 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbkzq\" (UniqueName: \"kubernetes.io/projected/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-kube-api-access-mbkzq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601286 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601862 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.601950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.601890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.603632 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.603612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.603805 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.603789 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.613127 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.613107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbkzq\" (UniqueName: \"kubernetes.io/projected/17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3-kube-api-access-mbkzq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zs9b4\" (UID: \"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.758380 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.758290 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:24:52.890007 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:52.889984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4"] Jul 07 15:24:52.891876 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:24:52.891852 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b3f0c8_54d0_4ec5_bdbb_cec4d18a76d3.slice/crio-848c7604a86cce0ebe201589c9cae2cc9903a8921c953e326364f4c0097c16db WatchSource:0}: Error finding container 848c7604a86cce0ebe201589c9cae2cc9903a8921c953e326364f4c0097c16db: Status 404 returned error can't find the container with id 848c7604a86cce0ebe201589c9cae2cc9903a8921c953e326364f4c0097c16db Jul 07 15:24:53.132568 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:53.132541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" event={"ID":"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3","Type":"ContainerStarted","Data":"848c7604a86cce0ebe201589c9cae2cc9903a8921c953e326364f4c0097c16db"} Jul 07 15:24:54.138129 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:54.138092 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" event={"ID":"17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3","Type":"ContainerStarted","Data":"5f63de2ccc3d3a0159aad50663a98351b2d3088aa28d7fac987c229544b22312"} Jul 07 15:24:54.158482 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:24:54.158436 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" podStartSLOduration=1.924299881 podStartE2EDuration="2.158420323s" totalImagesPullingTime="234.120442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:24:54.15631014 +0000 UTC m=+714.264705266" watchObservedRunningTime="2026-07-07 15:24:54.158420323 +0000 UTC m=+714.266815449" Jul 07 15:25:02.759183 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:02.759127 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:25:02.759675 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:02.759223 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:25:02.771739 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:02.771711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:25:03.189351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:03.189320 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zs9b4" Jul 07 15:25:03.964741 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:03.964690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:25:39.877467 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:39.877432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:25:39.944247 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:25:39.944212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:05.738344 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:26:05.738307 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:05.843623 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:26:05.843593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:06.890596 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:26:06.890571 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:07.157081 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:26:07.156990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:17.752422 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:27:17.752389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:19.478255 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:27:19.478213 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:02.529788 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:02.529749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:02.636224 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:02.636177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:02.917007 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:02.916892 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:09.129797 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:09.129759 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:09.276182 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:09.276148 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:09.423152 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:09.423067 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:09.558802 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:09.558773 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:15.910680 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:15.910645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:15.988642 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:15.988610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:30.384400 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:28:30.384365 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:38.506049 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:30:38.506016 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:23.947940 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:31:23.947849 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:19.364073 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:32:19.364035 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:19.434996 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:32:19.434946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:38:00.432972 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:38:00.432940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:00.363204 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:00.363165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:10.153748 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:10.153714 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:10.265016 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:10.264987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:10.649784 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:10.649748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:17.297403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.297372 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:17.400071 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.400033 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:17.522817 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.522787 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj"] Jul 07 15:39:17.526026 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.526002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.528557 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.528532 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e7011447-openshift-default-dockercfg-g98lx\"" Jul 07 15:39:17.559843 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.559757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:17.574191 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.574165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj"] Jul 07 15:39:17.648659 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.648630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:17.666889 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.666862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-credential-socket\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.666906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-socket\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.666979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-token\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.667010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zkjt\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-kube-api-access-9zkjt\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.667037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-envoy\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667220 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.667086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-certs\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667220 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.667166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istiod-ca-cert\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667300 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.667223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-data\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.667300 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.667240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-podinfo\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767692 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-credential-socket\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-socket\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-token\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zkjt\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-kube-api-access-9zkjt\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-envoy\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-certs\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.767871 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istiod-ca-cert\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768170 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-data\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768170 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.767922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-podinfo\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768170 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.768061 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-credential-socket\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.768169 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-socket\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.768284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-data\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.768465 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-certs\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.768693 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.768671 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istiod-ca-cert\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.770139 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.770120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-envoy\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.770274 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.770257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-podinfo\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.785882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.785857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-token\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.786725 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.786707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zkjt\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-kube-api-access-9zkjt\") pod \"e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.836135 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.836055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:17.973975 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.973949 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj"] Jul 07 15:39:17.975085 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:39:17.975057 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3289e3a3_8fe5_4da3_a4a0_0e8f5996fcb2.slice/crio-c3d27a92f26e95f8603e8f0b1a066fb5aec524514f518594d955c81a95c4f468 WatchSource:0}: Error finding container c3d27a92f26e95f8603e8f0b1a066fb5aec524514f518594d955c81a95c4f468: Status 404 returned error can't find the container with id c3d27a92f26e95f8603e8f0b1a066fb5aec524514f518594d955c81a95c4f468 Jul 07 15:39:17.979410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.977394 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:17.979410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.977471 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:17.979410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:17.977514 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:18.591309 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:18.591274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" event={"ID":"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2","Type":"ContainerStarted","Data":"8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e"} Jul 07 15:39:18.591813 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:18.591340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" event={"ID":"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2","Type":"ContainerStarted","Data":"c3d27a92f26e95f8603e8f0b1a066fb5aec524514f518594d955c81a95c4f468"} Jul 07 15:39:18.619981 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:18.619934 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" podStartSLOduration=1.61991846 podStartE2EDuration="1.61991846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:18.61952019 +0000 UTC m=+1578.727915317" watchObservedRunningTime="2026-07-07 15:39:18.61991846 +0000 UTC m=+1578.728313586" Jul 07 15:39:18.750147 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:18.750112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:18.836709 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:18.836665 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:18.883158 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:18.883067 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:19.001652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:19.001618 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:19.111113 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:19.111076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:19.594349 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:19.594311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:19.698989 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:19.698956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:19.841224 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:19.841192 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:20.600458 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:20.600428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:20.601541 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:20.601525 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:21.698966 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:21.698933 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:23.980506 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:23.980469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:24.137727 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:24.137684 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj"] Jul 07 15:39:24.137944 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:24.137924 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" podUID="3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" containerName="istio-proxy" containerID="cri-o://8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e" gracePeriod=30 Jul 07 15:39:24.179596 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:24.179550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:24.273798 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:24.273746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:24.447874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:24.447819 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:25.879875 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:25.879846 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:29.389989 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.389963 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:29.481265 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481168 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-credential-socket\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481265 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481207 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-certs\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481265 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481231 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istiod-ca-cert\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481265 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481255 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zkjt\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-kube-api-access-9zkjt\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481281 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-envoy\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481305 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-podinfo\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481331 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-data\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481487 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-socket\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481490 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481538 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-token\") pod \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\" (UID: \"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2\") " Jul 07 15:39:29.481579 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481544 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:29.481955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481710 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:29.481955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481660 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:39:29.481955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481895 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.481955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481912 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.481955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481925 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.481955 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.481937 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.482520 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.482496 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:29.483776 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.483753 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:29.483894 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.483803 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:29.483964 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.483946 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:39:29.484015 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.483994 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-kube-api-access-9zkjt" (OuterVolumeSpecName: "kube-api-access-9zkjt") pod "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" (UID: "3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2"). InnerVolumeSpecName "kube-api-access-9zkjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:29.582877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.582846 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.582877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.582873 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.582877 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.582882 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zkjt\" (UniqueName: \"kubernetes.io/projected/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-kube-api-access-9zkjt\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.583103 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.582890 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.583103 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.582899 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:29.637364 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.637330 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" containerID="8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e" exitCode=0 Jul 07 15:39:29.637536 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.637379 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" Jul 07 15:39:29.637536 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.637424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" event={"ID":"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2","Type":"ContainerDied","Data":"8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e"} Jul 07 15:39:29.637536 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.637487 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj" event={"ID":"3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2","Type":"ContainerDied","Data":"c3d27a92f26e95f8603e8f0b1a066fb5aec524514f518594d955c81a95c4f468"} Jul 07 15:39:29.637536 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.637515 2564 scope.go:117] "RemoveContainer" containerID="8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e" Jul 07 15:39:29.645802 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.645784 2564 scope.go:117] "RemoveContainer" containerID="8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e" Jul 07 15:39:29.646118 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:39:29.646097 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e\": container with ID starting with 8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e not found: ID does not exist" containerID="8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e" Jul 07 15:39:29.646187 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.646124 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e"} err="failed to get container status \"8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e\": rpc error: code = NotFound desc = could not find container \"8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e\": container with ID starting with 8237581fb06077dab9c03b4fe5e4479ba8c68fd154b3dbfcbad26645203c568e not found: ID does not exist" Jul 07 15:39:29.659751 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.659720 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj"] Jul 07 15:39:29.662777 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:29.662752 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e7011447-openshift-default-fbd84b6b5-zbzfj"] Jul 07 15:39:30.809667 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:30.809632 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:30.899943 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:30.899908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:31.058651 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.058624 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp"] Jul 07 15:39:31.058963 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.058949 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" containerName="istio-proxy" Jul 07 15:39:31.059010 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.058965 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" containerName="istio-proxy" Jul 07 15:39:31.059043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.059023 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" containerName="istio-proxy" Jul 07 15:39:31.061773 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.061733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.064368 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.064344 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-908066ab-openshift-default-dockercfg-qd9h4\"" Jul 07 15:39:31.084565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.084539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp"] Jul 07 15:39:31.095236 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-socket\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095350 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-credential-socket\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095350 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-istio-token\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095350 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntdfl\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-kube-api-access-ntdfl\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095454 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-envoy\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095454 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95450d1e-387a-4875-bb53-ea433bd19498-istio-podinfo\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095454 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-data\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095555 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95450d1e-387a-4875-bb53-ea433bd19498-istiod-ca-cert\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.095555 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.095494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-certs\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.097755 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.097732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:31.196410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95450d1e-387a-4875-bb53-ea433bd19498-istiod-ca-cert\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.196410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-certs\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.196667 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-socket\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.196667 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-credential-socket\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.196667 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-istio-token\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.196667 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntdfl\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-kube-api-access-ntdfl\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-envoy\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95450d1e-387a-4875-bb53-ea433bd19498-istio-podinfo\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-data\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.197017 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-socket\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.196961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-certs\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.197046 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-credential-socket\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.197278 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95450d1e-387a-4875-bb53-ea433bd19498-istiod-ca-cert\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.197564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.197345 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-data\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.199143 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.199122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-envoy\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.199290 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.199270 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95450d1e-387a-4875-bb53-ea433bd19498-istio-podinfo\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.210935 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.210909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:31.212354 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.212338 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntdfl\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-kube-api-access-ntdfl\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.212354 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.212349 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-istio-token\") pod \"e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.372278 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.372185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:31.502390 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.502365 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp"] Jul 07 15:39:31.504214 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:39:31.504187 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95450d1e_387a_4875_bb53_ea433bd19498.slice/crio-14c1eee38bdd9bad0eccf19552b52d27678686fae3f54bce41ba9b1b7e7a3750 WatchSource:0}: Error finding container 14c1eee38bdd9bad0eccf19552b52d27678686fae3f54bce41ba9b1b7e7a3750: Status 404 returned error can't find the container with id 14c1eee38bdd9bad0eccf19552b52d27678686fae3f54bce41ba9b1b7e7a3750 Jul 07 15:39:31.506203 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.506173 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:31.506272 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.506240 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:31.506310 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.506273 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:31.522680 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.522657 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2" path="/var/lib/kubelet/pods/3289e3a3-8fe5-4da3-a4a0-0e8f5996fcb2/volumes" Jul 07 15:39:31.656874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.654046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" event={"ID":"95450d1e-387a-4875-bb53-ea433bd19498","Type":"ContainerStarted","Data":"9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e"} Jul 07 15:39:31.656874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.654112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" event={"ID":"95450d1e-387a-4875-bb53-ea433bd19498","Type":"ContainerStarted","Data":"14c1eee38bdd9bad0eccf19552b52d27678686fae3f54bce41ba9b1b7e7a3750"} Jul 07 15:39:31.680856 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:31.680772 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" podStartSLOduration=0.680754058 podStartE2EDuration="680.754058ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:31.678852262 +0000 UTC m=+1591.787247382" watchObservedRunningTime="2026-07-07 15:39:31.680754058 +0000 UTC m=+1591.789149183" Jul 07 15:39:32.370172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.370136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:32.373111 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.373089 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:32.377768 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.377747 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:32.501168 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.501130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:32.658319 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.658234 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:32.659311 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.659293 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:32.662199 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.662169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:32.922246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:32.922157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:33.087232 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:33.087193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:33.184209 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:33.184119 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:34.398449 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:34.398407 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:37.585330 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:37.585295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:38.064541 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:38.064509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:43.706246 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.706213 2564 generic.go:356] "Generic (PLEG): container finished" podID="95450d1e-387a-4875-bb53-ea433bd19498" containerID="9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e" exitCode=0 Jul 07 15:39:43.706646 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.706299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" event={"ID":"95450d1e-387a-4875-bb53-ea433bd19498","Type":"ContainerDied","Data":"9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e"} Jul 07 15:39:43.706729 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.706716 2564 scope.go:117] "RemoveContainer" containerID="9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e" Jul 07 15:39:43.707685 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.707659 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:43.707752 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.707736 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:43.707800 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.707785 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:43.865126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.865091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:43.939790 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.939754 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp"] Jul 07 15:39:43.977348 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:43.977266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:44.079589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:44.079553 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:44.712818 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:44.712780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" event={"ID":"95450d1e-387a-4875-bb53-ea433bd19498","Type":"ContainerStarted","Data":"d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9"} Jul 07 15:39:44.713315 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:44.712927 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" containerID="cri-o://d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9" gracePeriod=30 Jul 07 15:39:46.209913 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:46.209883 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:47.659109 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:47.659076 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:49.959429 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:49.959405 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:50.068206 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068168 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntdfl\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-kube-api-access-ntdfl\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068206 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068209 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-data\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068229 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-certs\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068259 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-istio-token\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068279 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-credential-socket\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068586 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068462 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-envoy\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068586 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068500 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-socket\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068586 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068523 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:50.068586 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068543 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95450d1e-387a-4875-bb53-ea433bd19498-istiod-ca-cert\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068586 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068571 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95450d1e-387a-4875-bb53-ea433bd19498-istio-podinfo\") pod \"95450d1e-387a-4875-bb53-ea433bd19498\" (UID: \"95450d1e-387a-4875-bb53-ea433bd19498\") " Jul 07 15:39:50.068874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068604 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:50.068874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068753 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:50.069003 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068919 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.069003 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068938 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.069003 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068953 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.069003 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.068976 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95450d1e-387a-4875-bb53-ea433bd19498-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:39:50.069315 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.069288 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-data" (OuterVolumeSpecName: "istio-data") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:50.070625 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.070594 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:50.070733 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.070627 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-kube-api-access-ntdfl" (OuterVolumeSpecName: "kube-api-access-ntdfl") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "kube-api-access-ntdfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:50.070733 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.070647 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-istio-token" (OuterVolumeSpecName: "istio-token") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:50.070733 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.070672 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95450d1e-387a-4875-bb53-ea433bd19498-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95450d1e-387a-4875-bb53-ea433bd19498" (UID: "95450d1e-387a-4875-bb53-ea433bd19498"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:39:50.169990 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.169961 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntdfl\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-kube-api-access-ntdfl\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.169990 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.169985 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.169990 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.169995 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95450d1e-387a-4875-bb53-ea433bd19498-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.170205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.170003 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95450d1e-387a-4875-bb53-ea433bd19498-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.170205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.170011 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95450d1e-387a-4875-bb53-ea433bd19498-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.170205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.170020 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95450d1e-387a-4875-bb53-ea433bd19498-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:39:50.269958 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.269922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:50.370739 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.370653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:50.441328 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441292 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq"] Jul 07 15:39:50.441587 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441576 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" Jul 07 15:39:50.441634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441588 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" Jul 07 15:39:50.441634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441596 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" Jul 07 15:39:50.441634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441603 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" Jul 07 15:39:50.441745 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441646 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" Jul 07 15:39:50.441745 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.441655 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95450d1e-387a-4875-bb53-ea433bd19498" containerName="istio-proxy" Jul 07 15:39:50.444702 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.444680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.449236 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.449212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2b24ca6c-openshift-default-dockercfg-tkg7f\"" Jul 07 15:39:50.464199 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.464178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq"] Jul 07 15:39:50.489291 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.489258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:50.573977 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.573947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-socket\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574133 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.573997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-certs\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574133 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcxfh\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-kube-api-access-vcxfh\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574133 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-data\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574133 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb95536a-797b-4724-a6a8-853d277160c4-istiod-ca-cert\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574268 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-envoy\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574268 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb95536a-797b-4724-a6a8-853d277160c4-istio-podinfo\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574268 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-credential-socket\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.574268 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.574238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-istio-token\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.604203 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.604176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:50.675565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-data\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb95536a-797b-4724-a6a8-853d277160c4-istiod-ca-cert\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-envoy\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb95536a-797b-4724-a6a8-853d277160c4-istio-podinfo\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-credential-socket\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-istio-token\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-socket\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-certs\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.675841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcxfh\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-kube-api-access-vcxfh\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.676107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.675974 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-data\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.676168 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.676121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-credential-socket\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.676274 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.676237 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-certs\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.676355 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.676335 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-socket\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.676406 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.676339 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb95536a-797b-4724-a6a8-853d277160c4-istiod-ca-cert\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.677948 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.677928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-envoy\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.678062 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.678044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb95536a-797b-4724-a6a8-853d277160c4-istio-podinfo\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.684973 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.684954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-istio-token\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.685171 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.685155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcxfh\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-kube-api-access-vcxfh\") pod \"e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.741140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.741111 2564 generic.go:356] "Generic (PLEG): container finished" podID="95450d1e-387a-4875-bb53-ea433bd19498" containerID="d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9" exitCode=0 Jul 07 15:39:50.741275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.741163 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" event={"ID":"95450d1e-387a-4875-bb53-ea433bd19498","Type":"ContainerDied","Data":"d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9"} Jul 07 15:39:50.741275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.741169 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" Jul 07 15:39:50.741275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.741204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp" event={"ID":"95450d1e-387a-4875-bb53-ea433bd19498","Type":"ContainerDied","Data":"14c1eee38bdd9bad0eccf19552b52d27678686fae3f54bce41ba9b1b7e7a3750"} Jul 07 15:39:50.741275 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.741226 2564 scope.go:117] "RemoveContainer" containerID="d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9" Jul 07 15:39:50.750147 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.750124 2564 scope.go:117] "RemoveContainer" containerID="9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e" Jul 07 15:39:50.754299 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.754277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:50.757973 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.757948 2564 scope.go:117] "RemoveContainer" containerID="d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9" Jul 07 15:39:50.758357 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:39:50.758222 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9\": container with ID starting with d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9 not found: ID does not exist" containerID="d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9" Jul 07 15:39:50.758357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.758254 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9"} err="failed to get container status \"d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9\": rpc error: code = NotFound desc = could not find container \"d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9\": container with ID starting with d61944ff30fc894dad94159fb37c8518b4c97da7dea3132ffccb03ad9f17a1b9 not found: ID does not exist" Jul 07 15:39:50.758357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.758280 2564 scope.go:117] "RemoveContainer" containerID="9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e" Jul 07 15:39:50.758530 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:39:50.758496 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e\": container with ID starting with 9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e not found: ID does not exist" containerID="9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e" Jul 07 15:39:50.758530 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.758520 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e"} err="failed to get container status \"9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e\": rpc error: code = NotFound desc = could not find container \"9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e\": container with ID starting with 9bdf5240fd563ecffaba9d18cef8da440f59b0fa4306ca319c628b986e223e7e not found: ID does not exist" Jul 07 15:39:50.771551 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.771500 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp"] Jul 07 15:39:50.773442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.773418 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-908066ab-openshift-default-675448c7b7-6v8zp"] Jul 07 15:39:50.895305 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.895271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq"] Jul 07 15:39:50.898448 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:39:50.898418 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb95536a_797b_4724_a6a8_853d277160c4.slice/crio-d221924a5cfd4fe79e29ce193220405bb5cb79155ed10ac492d63005c57f8ba4 WatchSource:0}: Error finding container d221924a5cfd4fe79e29ce193220405bb5cb79155ed10ac492d63005c57f8ba4: Status 404 returned error can't find the container with id d221924a5cfd4fe79e29ce193220405bb5cb79155ed10ac492d63005c57f8ba4 Jul 07 15:39:50.900520 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.900488 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:50.900595 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.900566 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:50.900641 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:50.900593 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:39:51.521277 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.521237 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95450d1e-387a-4875-bb53-ea433bd19498" path="/var/lib/kubelet/pods/95450d1e-387a-4875-bb53-ea433bd19498/volumes" Jul 07 15:39:51.661144 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.661112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:51.752947 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.752913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" event={"ID":"cb95536a-797b-4724-a6a8-853d277160c4","Type":"ContainerStarted","Data":"a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154"} Jul 07 15:39:51.753093 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.753000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" event={"ID":"cb95536a-797b-4724-a6a8-853d277160c4","Type":"ContainerStarted","Data":"d221924a5cfd4fe79e29ce193220405bb5cb79155ed10ac492d63005c57f8ba4"} Jul 07 15:39:51.755406 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.755378 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:51.761798 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.761766 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:51.782471 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.782420 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" podStartSLOduration=1.782401208 podStartE2EDuration="1.782401208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:51.780001144 +0000 UTC m=+1611.888396295" watchObservedRunningTime="2026-07-07 15:39:51.782401208 +0000 UTC m=+1611.890796334" Jul 07 15:39:51.801639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.801619 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:51.908516 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:51.908472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:52.250926 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:52.250808 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:52.353428 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:52.353403 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:52.756657 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:52.756623 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:52.757647 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:52.757630 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:39:53.807596 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:53.807569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:56.305694 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:56.305660 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:56.409561 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:56.409528 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq"] Jul 07 15:39:56.409753 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:56.409701 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" podUID="cb95536a-797b-4724-a6a8-853d277160c4" containerName="istio-proxy" containerID="cri-o://a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154" gracePeriod=30 Jul 07 15:39:56.467068 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:56.467031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:56.566899 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:56.566660 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:56.673760 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:56.673728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:58.201720 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:39:58.201689 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:01.960960 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.960934 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:40:01.974176 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974150 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb95536a-797b-4724-a6a8-853d277160c4-istio-podinfo\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974189 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcxfh\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-kube-api-access-vcxfh\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974220 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-data\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974243 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb95536a-797b-4724-a6a8-853d277160c4-istiod-ca-cert\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974277 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-credential-socket\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974307 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-certs\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974344 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-istio-token\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974403 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974376 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-socket\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.974761 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974450 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-envoy\") pod \"cb95536a-797b-4724-a6a8-853d277160c4\" (UID: \"cb95536a-797b-4724-a6a8-853d277160c4\") " Jul 07 15:40:01.975264 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.974976 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:01.975264 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.975189 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:01.975264 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.975247 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:01.975538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.975246 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb95536a-797b-4724-a6a8-853d277160c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:40:01.975538 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.975385 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:01.976706 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.976672 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb95536a-797b-4724-a6a8-853d277160c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:40:01.976807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.976705 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:01.976807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.976745 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-kube-api-access-vcxfh" (OuterVolumeSpecName: "kube-api-access-vcxfh") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "kube-api-access-vcxfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:40:01.977297 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:01.977277 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb95536a-797b-4724-a6a8-853d277160c4" (UID: "cb95536a-797b-4724-a6a8-853d277160c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:40:02.075266 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075233 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075266 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075263 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb95536a-797b-4724-a6a8-853d277160c4-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075273 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcxfh\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-kube-api-access-vcxfh\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075281 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075292 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb95536a-797b-4724-a6a8-853d277160c4-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075299 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075309 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075317 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb95536a-797b-4724-a6a8-853d277160c4-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.075464 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.075324 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb95536a-797b-4724-a6a8-853d277160c4-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:40:02.800873 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.800820 2564 generic.go:356] "Generic (PLEG): container finished" podID="cb95536a-797b-4724-a6a8-853d277160c4" containerID="a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154" exitCode=0 Jul 07 15:40:02.800873 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.800859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" event={"ID":"cb95536a-797b-4724-a6a8-853d277160c4","Type":"ContainerDied","Data":"a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154"} Jul 07 15:40:02.800873 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.800873 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" Jul 07 15:40:02.801119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.800917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq" event={"ID":"cb95536a-797b-4724-a6a8-853d277160c4","Type":"ContainerDied","Data":"d221924a5cfd4fe79e29ce193220405bb5cb79155ed10ac492d63005c57f8ba4"} Jul 07 15:40:02.801119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.800942 2564 scope.go:117] "RemoveContainer" containerID="a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154" Jul 07 15:40:02.809388 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.809369 2564 scope.go:117] "RemoveContainer" containerID="a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154" Jul 07 15:40:02.809654 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:40:02.809633 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154\": container with ID starting with a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154 not found: ID does not exist" containerID="a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154" Jul 07 15:40:02.809711 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.809662 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154"} err="failed to get container status \"a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154\": rpc error: code = NotFound desc = could not find container \"a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154\": container with ID starting with a6613730deea4bd403c895a14e9787042f0ca4d87c728318753186412fb68154 not found: ID does not exist" Jul 07 15:40:02.830841 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.829184 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq"] Jul 07 15:40:02.833974 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:02.833951 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2b24ca6c-openshift-default-78687cb8cf-svhpq"] Jul 07 15:40:03.010363 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:03.010327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:03.126801 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:03.126713 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:03.498476 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:03.498393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:03.521032 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:03.521002 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb95536a-797b-4724-a6a8-853d277160c4" path="/var/lib/kubelet/pods/cb95536a-797b-4724-a6a8-853d277160c4/volumes" Jul 07 15:40:03.595100 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:03.595044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:03.695802 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:03.695769 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:05.133267 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:05.133224 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:11.654790 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:11.654747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:11.718252 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:11.718216 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:11.836064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:11.836034 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:11.919372 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:11.919273 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:12.677492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:12.677462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:38.630531 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:38.630495 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:44.616319 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:44.616286 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:44.717140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:44.717109 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:44.784374 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:44.784343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:44.880191 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:40:44.880078 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:01.008010 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:01.007973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:07.311735 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:07.311698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:07.405188 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:07.405155 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:07.511904 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:07.511873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:16.666005 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:16.665966 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:18.076959 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:18.076923 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:18.895751 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:18.895712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.269994 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:25.269905 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.392624 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:25.392581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.528096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:25.528070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.619699 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:25.619672 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.389451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:26.389419 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.486379 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:26.486343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.617158 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:26.617125 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:28.203697 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:28.203658 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:34.469513 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:34.469478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:34.571176 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:34.571143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:35.157297 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:35.157260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.025039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.025001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.103581 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.103554 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.252517 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.252486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.573360 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.573332 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw"] Jul 07 15:41:42.573634 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.573622 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb95536a-797b-4724-a6a8-853d277160c4" containerName="istio-proxy" Jul 07 15:41:42.573679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.573635 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb95536a-797b-4724-a6a8-853d277160c4" containerName="istio-proxy" Jul 07 15:41:42.573717 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.573696 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb95536a-797b-4724-a6a8-853d277160c4" containerName="istio-proxy" Jul 07 15:41:42.576531 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.576516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.589257 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.589234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-77bbe860-openshift-default-dockercfg-zffjf\"" Jul 07 15:41:42.604090 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.604056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw"] Jul 07 15:41:42.612291 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.612263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.698612 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.698573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.705808 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.705783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7268m\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-kube-api-access-7268m\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.705895 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.705815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-socket\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.705895 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.705884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-data\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.705975 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.705911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-token\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.705975 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.705940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-envoy\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.706049 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.705986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-credential-socket\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.706049 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.706005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istiod-ca-cert\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.706049 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.706036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-certs\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.706147 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.706050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-podinfo\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807514 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-certs\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807721 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-podinfo\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807721 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7268m\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-kube-api-access-7268m\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807721 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-socket\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807721 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-data\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807721 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-token\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.807721 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-envoy\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-credential-socket\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.807769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istiod-ca-cert\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808064 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.808004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-certs\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808215 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.808109 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-data\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808269 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.808220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-socket\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808337 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.808315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-credential-socket\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.808550 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.808523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istiod-ca-cert\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.809938 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.809920 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-envoy\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.810217 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.810200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-podinfo\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.818896 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.818865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7268m\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-kube-api-access-7268m\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.819490 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.819474 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-token\") pod \"e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:42.886365 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:42.886291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:43.014511 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.014481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw"] Jul 07 15:41:43.017405 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:41:43.017381 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe8ac64_1349_4614_85b8_7023f8c8ed60.slice/crio-34cff49aaced797e1b179afadb2e8fc1ce0936c529756b6ef666229a4f3b6e23 WatchSource:0}: Error finding container 34cff49aaced797e1b179afadb2e8fc1ce0936c529756b6ef666229a4f3b6e23: Status 404 returned error can't find the container with id 34cff49aaced797e1b179afadb2e8fc1ce0936c529756b6ef666229a4f3b6e23 Jul 07 15:41:43.019345 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.019311 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:41:43.019432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.019375 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:41:43.019432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.019400 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:41:43.201905 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.201791 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" event={"ID":"7fe8ac64-1349-4614-85b8-7023f8c8ed60","Type":"ContainerStarted","Data":"862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45"} Jul 07 15:41:43.201905 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.201857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" event={"ID":"7fe8ac64-1349-4614-85b8-7023f8c8ed60","Type":"ContainerStarted","Data":"34cff49aaced797e1b179afadb2e8fc1ce0936c529756b6ef666229a4f3b6e23"} Jul 07 15:41:43.228564 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.228507 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" podStartSLOduration=1.228485989 podStartE2EDuration="1.228485989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:43.225566577 +0000 UTC m=+1723.333961701" watchObservedRunningTime="2026-07-07 15:41:43.228485989 +0000 UTC m=+1723.336881114" Jul 07 15:41:43.886996 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:43.886952 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:44.891422 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:44.891392 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:45.210699 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:45.210606 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:45.211693 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:45.211676 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:45.561186 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:45.561157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:45.651000 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:45.650961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:45.793282 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:45.793250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:45.936236 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:45.936136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.380625 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:46.380585 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.480297 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:46.480262 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.967255 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:49.967223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:50.638378 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:50.638345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:50.757318 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:50.757285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:51.074524 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:51.074494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:57.338026 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:57.337994 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:57.437839 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:57.437796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:57.785923 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:57.785897 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:58.154045 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.154013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:58.279307 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.279279 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerID="862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45" exitCode=0 Jul 07 15:41:58.279475 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.279334 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" event={"ID":"7fe8ac64-1349-4614-85b8-7023f8c8ed60","Type":"ContainerDied","Data":"862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45"} Jul 07 15:41:58.279665 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.279653 2564 scope.go:117] "RemoveContainer" containerID="862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45" Jul 07 15:41:58.280527 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.280506 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:41:58.280580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.280566 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:41:58.280619 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.280595 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:41:58.463459 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:58.463380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:59.284402 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:59.284368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" event={"ID":"7fe8ac64-1349-4614-85b8-7023f8c8ed60","Type":"ContainerStarted","Data":"40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857"} Jul 07 15:41:59.887314 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:59.887282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:41:59.888413 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:59.888385 2564 patch_prober.go:28] interesting pod/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body= Jul 07 15:41:59.888527 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:41:59.888448 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" Jul 07 15:42:00.211589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:00.211512 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:42:00.887448 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:00.887409 2564 patch_prober.go:28] interesting pod/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body= Jul 07 15:42:00.887873 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:00.887468 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" Jul 07 15:42:01.887096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:01.887062 2564 patch_prober.go:28] interesting pod/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body= Jul 07 15:42:01.887279 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:01.887132 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" Jul 07 15:42:02.887639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:02.887602 2564 patch_prober.go:28] interesting pod/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body= Jul 07 15:42:02.888053 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:02.887672 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" Jul 07 15:42:03.890668 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:03.890640 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:42:03.891685 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:03.891666 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:42:04.870601 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:04.870567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:04.965610 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:04.965574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:05.121117 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.121033 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw"] Jul 07 15:42:05.140985 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.140958 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:05.307906 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.307866 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" containerID="cri-o://40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857" gracePeriod=30 Jul 07 15:42:05.365891 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.365855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:05.525547 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.525520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:05.623023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.622992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:05.746715 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:05.746685 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:10.562497 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.562475 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:42:10.644980 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.644877 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-socket\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.644980 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.644928 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7268m\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-kube-api-access-7268m\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.644980 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.644966 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-data\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.644994 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-token\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645012 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-envoy\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645033 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-credential-socket\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645052 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-podinfo\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645132 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-certs\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645203 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istiod-ca-cert\") pod \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\" (UID: \"7fe8ac64-1349-4614-85b8-7023f8c8ed60\") " Jul 07 15:42:10.645253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645224 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:42:10.645578 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645393 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:42:10.645578 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645504 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.645578 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645523 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.645764 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645593 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:42:10.645764 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645632 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:10.645947 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.645871 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-data" (OuterVolumeSpecName: "istio-data") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:42:10.647661 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.647634 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:42:10.647661 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.647643 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:42:10.647953 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.647924 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-token" (OuterVolumeSpecName: "istio-token") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:42:10.647953 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.647945 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-kube-api-access-7268m" (OuterVolumeSpecName: "kube-api-access-7268m") pod "7fe8ac64-1349-4614-85b8-7023f8c8ed60" (UID: "7fe8ac64-1349-4614-85b8-7023f8c8ed60"). InnerVolumeSpecName "kube-api-access-7268m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:42:10.746315 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746277 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7268m\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-kube-api-access-7268m\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.746315 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746307 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.746315 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746316 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.746315 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746325 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.746574 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746333 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ac64-1349-4614-85b8-7023f8c8ed60-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.746574 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746342 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:10.746574 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:10.746350 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ac64-1349-4614-85b8-7023f8c8ed60-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:42:11.337096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.337062 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerID="40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857" exitCode=0 Jul 07 15:42:11.337096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.337099 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" event={"ID":"7fe8ac64-1349-4614-85b8-7023f8c8ed60","Type":"ContainerDied","Data":"40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857"} Jul 07 15:42:11.337304 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.337109 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" Jul 07 15:42:11.337304 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.337136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw" event={"ID":"7fe8ac64-1349-4614-85b8-7023f8c8ed60","Type":"ContainerDied","Data":"34cff49aaced797e1b179afadb2e8fc1ce0936c529756b6ef666229a4f3b6e23"} Jul 07 15:42:11.337304 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.337157 2564 scope.go:117] "RemoveContainer" containerID="40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857" Jul 07 15:42:11.346264 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.346248 2564 scope.go:117] "RemoveContainer" containerID="862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45" Jul 07 15:42:11.353281 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.353264 2564 scope.go:117] "RemoveContainer" containerID="40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857" Jul 07 15:42:11.353523 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:42:11.353503 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857\": container with ID starting with 40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857 not found: ID does not exist" containerID="40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857" Jul 07 15:42:11.353580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.353529 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857"} err="failed to get container status \"40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857\": rpc error: code = NotFound desc = could not find container \"40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857\": container with ID starting with 40e536694f6a633fd51cf1d032215e32d29ddab4de50ebafd02b94f956c8e857 not found: ID does not exist" Jul 07 15:42:11.353580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.353545 2564 scope.go:117] "RemoveContainer" containerID="862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45" Jul 07 15:42:11.353759 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:42:11.353743 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45\": container with ID starting with 862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45 not found: ID does not exist" containerID="862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45" Jul 07 15:42:11.353799 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.353765 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45"} err="failed to get container status \"862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45\": rpc error: code = NotFound desc = could not find container \"862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45\": container with ID starting with 862cb60caeed5189589bbeb75648c3c4776acec35ba0ccd9c846fca972b74d45 not found: ID does not exist" Jul 07 15:42:11.362036 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.362016 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw"] Jul 07 15:42:11.365025 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.365006 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-77bbe860-openshift-default-68c85d75d7-fntvw"] Jul 07 15:42:11.522088 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.522061 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" path="/var/lib/kubelet/pods/7fe8ac64-1349-4614-85b8-7023f8c8ed60/volumes" Jul 07 15:42:11.972347 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:11.972315 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:12.039099 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:12.039069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:12.129638 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:12.129599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:12.241425 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:12.241338 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:12.337597 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:12.337548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:19.077223 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:19.077191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:19.153313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:19.153280 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:25.917949 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:25.917916 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:26.214311 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214232 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w"] Jul 07 15:42:26.214526 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214515 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" Jul 07 15:42:26.214566 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214528 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" Jul 07 15:42:26.214566 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214537 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" Jul 07 15:42:26.214566 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214543 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" Jul 07 15:42:26.214662 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214586 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" Jul 07 15:42:26.214662 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.214593 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fe8ac64-1349-4614-85b8-7023f8c8ed60" containerName="istio-proxy" Jul 07 15:42:26.218912 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.218893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.222161 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.222140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-73736f44-openshift-default-dockercfg-777nk\"" Jul 07 15:42:26.236674 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.236651 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w"] Jul 07 15:42:26.242703 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.242681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:26.283971 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.283938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-podinfo\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.283971 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.283972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqghq\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-kube-api-access-sqghq\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.283992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-socket\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.284025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-data\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.284085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-envoy\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.284125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-token\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.284153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-credential-socket\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.284197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-certs\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.284409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.284222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16970e42-ea36-4639-8d7e-ab623ac5dc77-istiod-ca-cert\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.384815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.384772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-podinfo\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.384815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.384821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqghq\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-kube-api-access-sqghq\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.384881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-socket\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.384926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-data\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.384984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-envoy\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-token\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-credential-socket\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-certs\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385114 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16970e42-ea36-4639-8d7e-ab623ac5dc77-istiod-ca-cert\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-data\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385543 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-credential-socket\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385596 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-certs\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385596 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385570 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-socket\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.385792 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.385775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16970e42-ea36-4639-8d7e-ab623ac5dc77-istiod-ca-cert\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.387685 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.387661 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-envoy\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.387815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.387799 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-podinfo\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.394426 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.394401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-token\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.394521 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.394509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqghq\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-kube-api-access-sqghq\") pod \"e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.528418 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.528373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:26.710779 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.710639 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w"] Jul 07 15:42:26.713479 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:42:26.713448 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16970e42_ea36_4639_8d7e_ab623ac5dc77.slice/crio-89e9a854f3c86c370bd533fcb58538622283867f15fd563567c28e66786ee9c0 WatchSource:0}: Error finding container 89e9a854f3c86c370bd533fcb58538622283867f15fd563567c28e66786ee9c0: Status 404 returned error can't find the container with id 89e9a854f3c86c370bd533fcb58538622283867f15fd563567c28e66786ee9c0 Jul 07 15:42:26.715623 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.715586 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:42:26.715710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.715657 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:42:26.715710 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.715690 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:42:26.924060 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:26.923976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:27.409580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:27.409548 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" event={"ID":"16970e42-ea36-4639-8d7e-ab623ac5dc77","Type":"ContainerStarted","Data":"67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8"} Jul 07 15:42:27.409781 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:27.409610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" event={"ID":"16970e42-ea36-4639-8d7e-ab623ac5dc77","Type":"ContainerStarted","Data":"89e9a854f3c86c370bd533fcb58538622283867f15fd563567c28e66786ee9c0"} Jul 07 15:42:27.436644 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:27.436582 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podStartSLOduration=1.436565926 podStartE2EDuration="1.436565926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:27.436116871 +0000 UTC m=+1767.544512005" watchObservedRunningTime="2026-07-07 15:42:27.436565926 +0000 UTC m=+1767.544961051" Jul 07 15:42:27.529356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:27.529322 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:27.534351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:27.534329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:28.414054 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:28.414024 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:28.414904 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:28.414882 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:29.473943 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:29.473912 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:29.582482 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:29.582453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:29.660094 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:29.660057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:29.837875 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:29.837822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:30.347182 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:30.347145 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:30.450186 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:30.450156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:33.976904 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:33.976864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:41.852800 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:41.852748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:42.579621 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:42.579586 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:42.680013 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:42.679983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:43.415617 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.415585 2564 patch_prober.go:28] interesting pod/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 07 15:42:43.416069 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.415670 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 07 15:42:43.484797 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.484766 2564 generic.go:356] "Generic (PLEG): container finished" podID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerID="67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8" exitCode=0 Jul 07 15:42:43.484969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.484805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" event={"ID":"16970e42-ea36-4639-8d7e-ab623ac5dc77","Type":"ContainerDied","Data":"67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8"} Jul 07 15:42:43.485205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.485191 2564 scope.go:117] "RemoveContainer" containerID="67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8" Jul 07 15:42:43.486184 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.486156 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:42:43.486283 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.486236 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:42:43.486341 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:43.486283 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:42:44.490708 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:44.490674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" event={"ID":"16970e42-ea36-4639-8d7e-ab623ac5dc77","Type":"ContainerStarted","Data":"67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b"} Jul 07 15:42:44.528944 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:44.528903 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:44.529291 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:44.529269 2564 patch_prober.go:28] interesting pod/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 07 15:42:44.529338 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:44.529316 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 07 15:42:45.529138 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:45.529108 2564 patch_prober.go:28] interesting pod/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 07 15:42:45.529504 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:45.529155 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 07 15:42:46.529169 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:46.529138 2564 patch_prober.go:28] interesting pod/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 07 15:42:46.529532 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:46.529192 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 07 15:42:47.529504 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:47.529466 2564 patch_prober.go:28] interesting pod/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 07 15:42:47.529876 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:47.529518 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 07 15:42:48.532343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:48.532315 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:48.532820 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:48.532562 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:48.533165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:48.533151 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:42:51.010280 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:51.010244 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:51.112410 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:42:51.112374 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:16.798018 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:43:16.797985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:18.097302 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:43:18.097268 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:22.889372 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:43:22.889346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:27.973547 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:43:27.973514 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:04.257953 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:04.257916 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:05.695185 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:05.695150 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:12.148445 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:12.148413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:12.250159 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:12.250128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:12.429796 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:12.429712 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w"] Jul 07 15:44:12.430010 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:12.429963 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" containerID="cri-o://67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b" gracePeriod=30 Jul 07 15:44:12.448838 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:12.448804 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:12.741527 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:12.741433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:13.829824 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:13.829789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:13.928383 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:13.928353 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:14.045194 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:14.045161 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:14.772145 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:14.772102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:14.866969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:14.866936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:14.971698 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:14.971655 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:16.396991 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:16.396957 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:17.674107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.674082 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:44:17.834802 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.834766 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-envoy\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.834808 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-credential-socket\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.834874 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-podinfo\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.834916 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-certs\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.834975 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-token\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835008 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-socket\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835289 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835144 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqghq\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-kube-api-access-sqghq\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835289 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835151 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:44:17.835289 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835195 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16970e42-ea36-4639-8d7e-ab623ac5dc77-istiod-ca-cert\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835289 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835210 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:44:17.835289 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835250 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-data\") pod \"16970e42-ea36-4639-8d7e-ab623ac5dc77\" (UID: \"16970e42-ea36-4639-8d7e-ab623ac5dc77\") " Jul 07 15:44:17.835289 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835269 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:44:17.835589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835511 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.835589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835532 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.835589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835546 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.835733 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.835615 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16970e42-ea36-4639-8d7e-ab623ac5dc77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:44:17.836160 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.836138 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-data" (OuterVolumeSpecName: "istio-data") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:44:17.837149 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.837131 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:44:17.837276 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.837168 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:44:17.837543 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.837525 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-token" (OuterVolumeSpecName: "istio-token") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:44:17.837589 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.837554 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-kube-api-access-sqghq" (OuterVolumeSpecName: "kube-api-access-sqghq") pod "16970e42-ea36-4639-8d7e-ab623ac5dc77" (UID: "16970e42-ea36-4639-8d7e-ab623ac5dc77"). InnerVolumeSpecName "kube-api-access-sqghq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:44:17.881884 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.881849 2564 generic.go:356] "Generic (PLEG): container finished" podID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerID="67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b" exitCode=0 Jul 07 15:44:17.882043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.881901 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" Jul 07 15:44:17.882043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.881912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" event={"ID":"16970e42-ea36-4639-8d7e-ab623ac5dc77","Type":"ContainerDied","Data":"67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b"} Jul 07 15:44:17.882043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.881964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w" event={"ID":"16970e42-ea36-4639-8d7e-ab623ac5dc77","Type":"ContainerDied","Data":"89e9a854f3c86c370bd533fcb58538622283867f15fd563567c28e66786ee9c0"} Jul 07 15:44:17.882043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.881995 2564 scope.go:117] "RemoveContainer" containerID="67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b" Jul 07 15:44:17.890581 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.890565 2564 scope.go:117] "RemoveContainer" containerID="67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8" Jul 07 15:44:17.897658 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.897642 2564 scope.go:117] "RemoveContainer" containerID="67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b" Jul 07 15:44:17.897902 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:44:17.897883 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b\": container with ID starting with 67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b not found: ID does not exist" containerID="67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b" Jul 07 15:44:17.897970 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.897911 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b"} err="failed to get container status \"67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b\": rpc error: code = NotFound desc = could not find container \"67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b\": container with ID starting with 67d74e4eccde9aad69676c42678157c8bf46226c81bc4c0d1497595e937aa95b not found: ID does not exist" Jul 07 15:44:17.897970 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.897927 2564 scope.go:117] "RemoveContainer" containerID="67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8" Jul 07 15:44:17.898134 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:44:17.898120 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8\": container with ID starting with 67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8 not found: ID does not exist" containerID="67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8" Jul 07 15:44:17.898173 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.898138 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8"} err="failed to get container status \"67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8\": rpc error: code = NotFound desc = could not find container \"67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8\": container with ID starting with 67e15f75e99d1514ddd710281a98cef72a23b6f8038d7aa1c57a5ffcb936d2d8 not found: ID does not exist" Jul 07 15:44:17.904320 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.904300 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w"] Jul 07 15:44:17.909168 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.909148 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-73736f44-openshift-default-84bf9c55f-mz57w"] Jul 07 15:44:17.936405 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.936380 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.936405 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.936402 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqghq\" (UniqueName: \"kubernetes.io/projected/16970e42-ea36-4639-8d7e-ab623ac5dc77-kube-api-access-sqghq\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.936533 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.936411 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16970e42-ea36-4639-8d7e-ab623ac5dc77-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.936533 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.936420 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.936533 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.936428 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:17.936533 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:17.936435 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16970e42-ea36-4639-8d7e-ab623ac5dc77-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:44:19.521419 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:19.521385 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" path="/var/lib/kubelet/pods/16970e42-ea36-4639-8d7e-ab623ac5dc77/volumes" Jul 07 15:44:22.802562 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:22.802482 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:22.892703 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:22.892669 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:23.554229 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:23.554181 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:29.547107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:29.547074 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:29.653452 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:29.653420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:29.751161 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:29.751129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:40.265534 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:40.265490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:40.601007 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:44:40.600971 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:01.573789 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:01.573753 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:07.743263 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:07.743223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:07.844527 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:07.844490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:08.091325 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.091290 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:08.363800 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.363728 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj"] Jul 07 15:45:08.364060 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.364041 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" Jul 07 15:45:08.364060 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.364057 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" Jul 07 15:45:08.364217 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.364068 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" Jul 07 15:45:08.364217 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.364073 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" Jul 07 15:45:08.364217 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.364119 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" Jul 07 15:45:08.367070 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.367051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.369695 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.369663 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-99d0b0-openshift-default-dockercfg-gtfq4\"" Jul 07 15:45:08.379350 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.379326 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj"] Jul 07 15:45:08.409547 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.409518 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:08.464002 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.463971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-socket\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465516 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6rb\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-kube-api-access-zl6rb\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465681 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecda443d-5a34-490c-a863-db642751434d-istiod-ca-cert\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465681 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecda443d-5a34-490c-a863-db642751434d-istio-podinfo\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465681 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-credential-socket\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-data\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-envoy\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-istio-token\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.465874 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.465850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-certs\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.550576 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.550546 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:08.566847 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.566807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-data\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.566997 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.566870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-envoy\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.566997 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.566907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-istio-token\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.566997 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.566937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-certs\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.566997 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.566995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-socket\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6rb\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-kube-api-access-zl6rb\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecda443d-5a34-490c-a863-db642751434d-istiod-ca-cert\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecda443d-5a34-490c-a863-db642751434d-istio-podinfo\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-credential-socket\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-data\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567534 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-certs\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567534 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-credential-socket\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567655 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-socket\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.567800 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.567779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecda443d-5a34-490c-a863-db642751434d-istiod-ca-cert\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.569172 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.569152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-envoy\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.569541 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.569523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecda443d-5a34-490c-a863-db642751434d-istio-podinfo\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.574823 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.574796 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-istio-token\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.575002 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.574986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6rb\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-kube-api-access-zl6rb\") pod \"e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.676685 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.676602 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:08.808301 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.808266 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj"] Jul 07 15:45:08.811325 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:45:08.811295 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecda443d_5a34_490c_a863_db642751434d.slice/crio-e9ae54f7a0d6030b33abce34e2d426011d352f908fa9c5dcf7a206f73bb27e55 WatchSource:0}: Error finding container e9ae54f7a0d6030b33abce34e2d426011d352f908fa9c5dcf7a206f73bb27e55: Status 404 returned error can't find the container with id e9ae54f7a0d6030b33abce34e2d426011d352f908fa9c5dcf7a206f73bb27e55 Jul 07 15:45:08.813508 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.813481 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:08.813567 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.813543 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:08.813606 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:08.813569 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:09.092677 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:09.092638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" event={"ID":"ecda443d-5a34-490c-a863-db642751434d","Type":"ContainerStarted","Data":"d135bae37753081cc056a55b1e2ea65d9b380f636e9c3997924777be0f1ceb58"} Jul 07 15:45:09.092866 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:09.092733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" event={"ID":"ecda443d-5a34-490c-a863-db642751434d","Type":"ContainerStarted","Data":"e9ae54f7a0d6030b33abce34e2d426011d352f908fa9c5dcf7a206f73bb27e55"} Jul 07 15:45:09.114155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:09.113973 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podStartSLOduration=1.113945162 podStartE2EDuration="1.113945162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:09.113467816 +0000 UTC m=+1929.221862943" watchObservedRunningTime="2026-07-07 15:45:09.113945162 +0000 UTC m=+1929.222340289" Jul 07 15:45:09.677012 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:09.676982 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:09.681281 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:09.681260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:10.096432 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:10.096391 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:10.097251 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:10.097234 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:11.207950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:11.207918 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:11.324094 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:11.324057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:11.423231 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:11.423195 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:11.581776 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:11.581739 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:12.095705 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:12.095675 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:12.196478 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:12.196448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:15.746757 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:15.746727 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:16.090296 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.090261 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:16.374793 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.374708 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x"] Jul 07 15:45:16.375082 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.375068 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="16970e42-ea36-4639-8d7e-ab623ac5dc77" containerName="istio-proxy" Jul 07 15:45:16.378136 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.378117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.380741 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.380721 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ffde9f-openshift-default-dockercfg-cl5zr\"" Jul 07 15:45:16.391593 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.391572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x"] Jul 07 15:45:16.410642 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.410610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:16.534180 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-socket\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534180 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-envoy\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-podinfo\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08dc27f8-07ed-450f-94c9-398db470ed8b-istiod-ca-cert\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh52g\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-kube-api-access-sh52g\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-data\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-token\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-credential-socket\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.534396 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.534347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-certs\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.634182 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.634105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:16.635168 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-socket\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635249 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-envoy\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635249 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-podinfo\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635249 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08dc27f8-07ed-450f-94c9-398db470ed8b-istiod-ca-cert\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635398 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh52g\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-kube-api-access-sh52g\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635447 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-data\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635510 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-token\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-credential-socket\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-certs\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635673 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635661 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-socket\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-certs\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.635969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.635955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08dc27f8-07ed-450f-94c9-398db470ed8b-istiod-ca-cert\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.636182 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.636033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-credential-socket\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.636182 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.636084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-data\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.637651 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.637630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-envoy\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.637764 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.637748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-podinfo\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.643505 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.643481 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-token\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.643679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.643657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh52g\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-kube-api-access-sh52g\") pod \"e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.688694 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.688661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:16.822104 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.822075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x"] Jul 07 15:45:16.824148 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:45:16.824119 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dc27f8_07ed_450f_94c9_398db470ed8b.slice/crio-07124837c87ca58ad52e3d89d5095b2deb13594ab53c6b5395b1be5b3136c9ed WatchSource:0}: Error finding container 07124837c87ca58ad52e3d89d5095b2deb13594ab53c6b5395b1be5b3136c9ed: Status 404 returned error can't find the container with id 07124837c87ca58ad52e3d89d5095b2deb13594ab53c6b5395b1be5b3136c9ed Jul 07 15:45:16.826369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.826339 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:16.826457 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.826404 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:16.826457 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:16.826435 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:17.129043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:17.129003 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" event={"ID":"08dc27f8-07ed-450f-94c9-398db470ed8b","Type":"ContainerStarted","Data":"ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8"} Jul 07 15:45:17.129221 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:17.129063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" event={"ID":"08dc27f8-07ed-450f-94c9-398db470ed8b","Type":"ContainerStarted","Data":"07124837c87ca58ad52e3d89d5095b2deb13594ab53c6b5395b1be5b3136c9ed"} Jul 07 15:45:17.152924 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:17.152877 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podStartSLOduration=1.152861298 podStartE2EDuration="1.152861298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:17.151209458 +0000 UTC m=+1937.259604585" watchObservedRunningTime="2026-07-07 15:45:17.152861298 +0000 UTC m=+1937.261256423" Jul 07 15:45:17.689312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:17.689277 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:17.694091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:17.694067 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:18.133342 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:18.133313 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:18.134424 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:18.134404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:19.227278 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:19.227231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:19.310117 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:19.310085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:19.378053 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:19.378017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:19.714873 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:19.714818 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:19.865507 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:19.865466 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:19.966125 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:19.966030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:23.739804 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:23.739767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:26.138090 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:26.138045 2564 patch_prober.go:28] interesting pod/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 15:45:26.138715 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:26.138684 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 15:45:27.179175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:27.179082 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecda443d-5a34-490c-a863-db642751434d" containerID="d135bae37753081cc056a55b1e2ea65d9b380f636e9c3997924777be0f1ceb58" exitCode=0 Jul 07 15:45:27.179175 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:27.179144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" event={"ID":"ecda443d-5a34-490c-a863-db642751434d","Type":"ContainerDied","Data":"d135bae37753081cc056a55b1e2ea65d9b380f636e9c3997924777be0f1ceb58"} Jul 07 15:45:27.179648 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:27.179536 2564 scope.go:117] "RemoveContainer" containerID="d135bae37753081cc056a55b1e2ea65d9b380f636e9c3997924777be0f1ceb58" Jul 07 15:45:27.180565 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:27.180537 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:27.180649 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:27.180631 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:27.180724 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:27.180709 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:28.187925 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:28.187886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" event={"ID":"ecda443d-5a34-490c-a863-db642751434d","Type":"ContainerStarted","Data":"89724da48d1762b814ce1384097e717f835d8632e693e4ac1d2b0651574e282b"} Jul 07 15:45:28.677920 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:28.677444 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:28.677920 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:28.677569 2564 patch_prober.go:28] interesting pod/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:45:28.677920 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:28.677625 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 07 15:45:29.678245 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:29.677101 2564 patch_prober.go:28] interesting pod/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:45:29.678245 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:29.677167 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 07 15:45:30.677940 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:30.677897 2564 patch_prober.go:28] interesting pod/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:45:30.678119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:30.677966 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 07 15:45:31.677636 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:31.677586 2564 patch_prober.go:28] interesting pod/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:45:31.678136 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:31.677644 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 07 15:45:32.680502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:32.680472 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:32.680969 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:32.680868 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:32.681499 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:32.681484 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:45:33.135282 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.135248 2564 patch_prober.go:28] interesting pod/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 07 15:45:33.135475 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.135305 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 07 15:45:33.211900 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.211868 2564 generic.go:356] "Generic (PLEG): container finished" podID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerID="ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8" exitCode=0 Jul 07 15:45:33.212069 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.211942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" event={"ID":"08dc27f8-07ed-450f-94c9-398db470ed8b","Type":"ContainerDied","Data":"ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8"} Jul 07 15:45:33.212484 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.212469 2564 scope.go:117] "RemoveContainer" containerID="ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8" Jul 07 15:45:33.213472 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.213447 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:33.213526 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.213509 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:33.213560 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.213542 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:45:33.800473 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.800391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.901467 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:33.901433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:34.218266 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:34.218182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" event={"ID":"08dc27f8-07ed-450f-94c9-398db470ed8b","Type":"ContainerStarted","Data":"4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832"} Jul 07 15:45:34.689773 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:34.689732 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:34.690013 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:34.689992 2564 patch_prober.go:28] interesting pod/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 07 15:45:34.690074 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:34.690042 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 07 15:45:35.689930 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:35.689892 2564 patch_prober.go:28] interesting pod/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 07 15:45:35.690310 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:35.689948 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 07 15:45:36.689625 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:36.689585 2564 patch_prober.go:28] interesting pod/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 07 15:45:36.689816 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:36.689641 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 07 15:45:37.689580 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:37.689539 2564 patch_prober.go:28] interesting pod/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 07 15:45:37.690086 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:37.689602 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 07 15:45:38.692767 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:38.692734 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:38.693235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:38.693016 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:38.693788 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:38.693774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:45:39.260652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:39.260618 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:41.467468 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:41.467430 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:41.566451 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:41.566413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:54.869091 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:54.869058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:54.968807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:45:54.968770 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:07.575995 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:07.575965 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:19.676450 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:19.676419 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:19.793005 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:19.792973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:27.452655 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:27.452627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:28.403664 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:28.403629 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:28.563104 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:28.563075 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:28.958202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:28.958165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:29.070526 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:29.070492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:29.171065 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:29.171020 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:29.347017 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:29.346979 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:30.683906 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:30.683872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:30.783681 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:30.783654 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:30.868701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:30.868664 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:34.035534 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:46:34.035501 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:03.091697 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:03.091659 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:04.447030 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:04.446998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:11.179641 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:11.179592 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:11.479998 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:11.479912 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj"] Jul 07 15:47:11.480161 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:11.480127 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" containerID="cri-o://89724da48d1762b814ce1384097e717f835d8632e693e4ac1d2b0651574e282b" gracePeriod=30 Jul 07 15:47:11.500798 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:11.500766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:11.722271 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:11.722227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:11.884860 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:11.884814 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:12.285964 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:12.285930 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:12.386046 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:12.386012 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:12.487081 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:12.487049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:12.609861 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:12.609758 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:16.644390 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.644352 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecda443d-5a34-490c-a863-db642751434d" containerID="89724da48d1762b814ce1384097e717f835d8632e693e4ac1d2b0651574e282b" exitCode=0 Jul 07 15:47:16.644894 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.644427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" event={"ID":"ecda443d-5a34-490c-a863-db642751434d","Type":"ContainerDied","Data":"89724da48d1762b814ce1384097e717f835d8632e693e4ac1d2b0651574e282b"} Jul 07 15:47:16.644894 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.644492 2564 scope.go:117] "RemoveContainer" containerID="d135bae37753081cc056a55b1e2ea65d9b380f636e9c3997924777be0f1ceb58" Jul 07 15:47:16.737927 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.737906 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:47:16.911725 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911691 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl6rb\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-kube-api-access-zl6rb\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.911725 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911731 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-istio-token\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911753 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecda443d-5a34-490c-a863-db642751434d-istiod-ca-cert\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911779 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-socket\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911816 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-credential-socket\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911882 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecda443d-5a34-490c-a863-db642751434d-istio-podinfo\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911938 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-certs\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.911991 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-envoy\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912023 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-data\") pod \"ecda443d-5a34-490c-a863-db642751434d\" (UID: \"ecda443d-5a34-490c-a863-db642751434d\") " Jul 07 15:47:16.912377 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912116 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:16.912377 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912206 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:16.912377 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912324 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecda443d-5a34-490c-a863-db642751434d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:47:16.912522 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912379 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:16.912522 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912399 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:16.912522 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912396 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:16.913011 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.912989 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:16.914095 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.914069 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:16.914195 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.914096 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-kube-api-access-zl6rb" (OuterVolumeSpecName: "kube-api-access-zl6rb") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "kube-api-access-zl6rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:16.914599 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.914582 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:16.914673 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:16.914592 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecda443d-5a34-490c-a863-db642751434d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecda443d-5a34-490c-a863-db642751434d" (UID: "ecda443d-5a34-490c-a863-db642751434d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:47:17.013882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013803 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecda443d-5a34-490c-a863-db642751434d-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.013882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013876 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.013882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013885 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.013882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013894 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecda443d-5a34-490c-a863-db642751434d-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.013882 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013902 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl6rb\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-kube-api-access-zl6rb\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.014189 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013911 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecda443d-5a34-490c-a863-db642751434d-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.014189 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.013919 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecda443d-5a34-490c-a863-db642751434d-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:17.650701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.650676 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" Jul 07 15:47:17.650701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.650682 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj" event={"ID":"ecda443d-5a34-490c-a863-db642751434d","Type":"ContainerDied","Data":"e9ae54f7a0d6030b33abce34e2d426011d352f908fa9c5dcf7a206f73bb27e55"} Jul 07 15:47:17.651156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.650738 2564 scope.go:117] "RemoveContainer" containerID="89724da48d1762b814ce1384097e717f835d8632e693e4ac1d2b0651574e282b" Jul 07 15:47:17.670312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.670284 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj"] Jul 07 15:47:17.675126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:17.675095 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-99d0b0-openshift-default-6794bc6bbf-ndsrj"] Jul 07 15:47:18.425719 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:18.425684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:18.525678 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:18.525640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:18.717697 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:18.717596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:18.723711 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:18.723683 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x"] Jul 07 15:47:18.723939 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:18.723913 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" containerID="cri-o://4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832" gracePeriod=30 Jul 07 15:47:18.942166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:18.942128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:19.270185 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.270155 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:19.521847 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.521752 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecda443d-5a34-490c-a863-db642751434d" path="/var/lib/kubelet/pods/ecda443d-5a34-490c-a863-db642751434d/volumes" Jul 07 15:47:19.556400 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.556374 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9"] Jul 07 15:47:19.556678 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.556663 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" Jul 07 15:47:19.556734 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.556679 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" Jul 07 15:47:19.556734 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.556693 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" Jul 07 15:47:19.556734 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.556698 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" Jul 07 15:47:19.556854 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.556749 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" Jul 07 15:47:19.560747 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.560730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.563011 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.562989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-face20-openshift-default-dockercfg-2qrvn\"" Jul 07 15:47:19.572122 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.572100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9"] Jul 07 15:47:19.584343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.584311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:19.736195 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-podinfo\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-data\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-token\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-credential-socket\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-certs\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-envoy\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istiod-ca-cert\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-socket\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.736588 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.736453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dsw4\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-kube-api-access-5dsw4\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.825121 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.825086 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:19.837205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-socket\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837280 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dsw4\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-kube-api-access-5dsw4\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837367 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-podinfo\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837435 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-data\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837473 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-token\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837527 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-credential-socket\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837527 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-certs\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837624 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-socket\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837686 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-envoy\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837734 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istiod-ca-cert\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837787 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-data\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837867 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837786 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-certs\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.837867 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.837816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-credential-socket\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.838322 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.838301 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istiod-ca-cert\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.839705 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.839683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-envoy\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.839886 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.839869 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-podinfo\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.845142 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.845117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-token\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.845485 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.845464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dsw4\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-kube-api-access-5dsw4\") pod \"e2e-api-a-face20-openshift-default-d57c66665-wlcg9\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:19.870415 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:19.870387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:20.003457 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.003422 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9"] Jul 07 15:47:20.006579 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:47:20.006540 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68fd0e5_645e_43ae_bae1_4bb34cad721a.slice/crio-3e226bdd3633a2764a593414593fe30bf08f0f00ec94de9b96ed25c4fef31320 WatchSource:0}: Error finding container 3e226bdd3633a2764a593414593fe30bf08f0f00ec94de9b96ed25c4fef31320: Status 404 returned error can't find the container with id 3e226bdd3633a2764a593414593fe30bf08f0f00ec94de9b96ed25c4fef31320 Jul 07 15:47:20.008534 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.008505 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:20.008645 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.008567 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:20.008645 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.008608 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:20.669252 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.669211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" event={"ID":"d68fd0e5-645e-43ae-bae1-4bb34cad721a","Type":"ContainerStarted","Data":"76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855"} Jul 07 15:47:20.669252 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.669260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" event={"ID":"d68fd0e5-645e-43ae-bae1-4bb34cad721a","Type":"ContainerStarted","Data":"3e226bdd3633a2764a593414593fe30bf08f0f00ec94de9b96ed25c4fef31320"} Jul 07 15:47:20.690777 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.690728 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" podStartSLOduration=1.690714512 podStartE2EDuration="1.690714512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:20.689778521 +0000 UTC m=+2060.798173660" watchObservedRunningTime="2026-07-07 15:47:20.690714512 +0000 UTC m=+2060.799109639" Jul 07 15:47:20.871510 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:20.871478 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:21.876125 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:21.876097 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:22.677652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:22.677624 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:22.678633 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:22.678605 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:22.746024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:22.745992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:22.842370 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:22.842334 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:22.952044 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:22.951957 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.149285 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:23.149249 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.276662 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:23.276633 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.377130 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:23.377099 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.695954 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:23.695876 2564 patch_prober.go:28] interesting pod/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 15:47:23.695954 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:23.695940 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:47:23.973973 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:23.973947 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:47:24.077623 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077592 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-token\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.077864 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077656 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-certs\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.077864 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077687 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-podinfo\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.077864 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-data\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.077864 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077781 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08dc27f8-07ed-450f-94c9-398db470ed8b-istiod-ca-cert\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.077864 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077803 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-credential-socket\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.078119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077872 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-socket\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.078119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077899 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh52g\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-kube-api-access-sh52g\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.078119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.077958 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-envoy\") pod \"08dc27f8-07ed-450f-94c9-398db470ed8b\" (UID: \"08dc27f8-07ed-450f-94c9-398db470ed8b\") " Jul 07 15:47:24.078119 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.078059 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:24.078313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.078205 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08dc27f8-07ed-450f-94c9-398db470ed8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:47:24.078313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.078237 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:24.078313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.078266 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.078474 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.078367 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:24.078807 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.078773 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:24.080000 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.079971 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:24.080107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.080030 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:47:24.080163 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.080126 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-kube-api-access-sh52g" (OuterVolumeSpecName: "kube-api-access-sh52g") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "kube-api-access-sh52g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:24.080202 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.080162 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08dc27f8-07ed-450f-94c9-398db470ed8b" (UID: "08dc27f8-07ed-450f-94c9-398db470ed8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:24.179404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179353 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179397 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08dc27f8-07ed-450f-94c9-398db470ed8b-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179406 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179416 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179404 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179424 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh52g\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-kube-api-access-sh52g\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179434 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179442 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.179714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.179449 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08dc27f8-07ed-450f-94c9-398db470ed8b-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.687743 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.687711 2564 generic.go:356] "Generic (PLEG): container finished" podID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerID="4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832" exitCode=0 Jul 07 15:47:24.687951 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.687756 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" Jul 07 15:47:24.687951 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.687796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" event={"ID":"08dc27f8-07ed-450f-94c9-398db470ed8b","Type":"ContainerDied","Data":"4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832"} Jul 07 15:47:24.687951 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.687869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x" event={"ID":"08dc27f8-07ed-450f-94c9-398db470ed8b","Type":"ContainerDied","Data":"07124837c87ca58ad52e3d89d5095b2deb13594ab53c6b5395b1be5b3136c9ed"} Jul 07 15:47:24.687951 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.687893 2564 scope.go:117] "RemoveContainer" containerID="4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832" Jul 07 15:47:24.696767 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.696744 2564 scope.go:117] "RemoveContainer" containerID="ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8" Jul 07 15:47:24.704079 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.704052 2564 scope.go:117] "RemoveContainer" containerID="4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832" Jul 07 15:47:24.704302 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:47:24.704284 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832\": container with ID starting with 4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832 not found: ID does not exist" containerID="4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832" Jul 07 15:47:24.704353 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.704311 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832"} err="failed to get container status \"4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832\": rpc error: code = NotFound desc = could not find container \"4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832\": container with ID starting with 4624b40ba2ac20dc8f39886d57a687e06860c0188fb519181a72b946d6f6d832 not found: ID does not exist" Jul 07 15:47:24.704353 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.704328 2564 scope.go:117] "RemoveContainer" containerID="ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8" Jul 07 15:47:24.704567 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:47:24.704552 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8\": container with ID starting with ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8 not found: ID does not exist" containerID="ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8" Jul 07 15:47:24.704629 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.704570 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8"} err="failed to get container status \"ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8\": rpc error: code = NotFound desc = could not find container \"ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8\": container with ID starting with ba95669586b3d3f03ea6109f7b3fe8b7a1572ffe97f8eae12551230fdddd62e8 not found: ID does not exist" Jul 07 15:47:24.708494 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.708472 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x"] Jul 07 15:47:24.714270 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:24.714250 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ffde9f-openshift-default-657c6bfc7f-bjh7x"] Jul 07 15:47:25.521745 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:25.521715 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" path="/var/lib/kubelet/pods/08dc27f8-07ed-450f-94c9-398db470ed8b/volumes" Jul 07 15:47:27.220673 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.220640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:27.667569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.667534 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:27.928967 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.928889 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr"] Jul 07 15:47:27.929243 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929227 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" Jul 07 15:47:27.929329 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929247 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" Jul 07 15:47:27.929329 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929274 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" Jul 07 15:47:27.929329 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929283 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" Jul 07 15:47:27.929469 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929361 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" Jul 07 15:47:27.929469 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929374 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecda443d-5a34-490c-a863-db642751434d" containerName="istio-proxy" Jul 07 15:47:27.929469 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.929384 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08dc27f8-07ed-450f-94c9-398db470ed8b" containerName="istio-proxy" Jul 07 15:47:27.933633 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.933612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:27.936439 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.936419 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7c4422-openshift-default-dockercfg-7rspk\"" Jul 07 15:47:27.944077 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.944056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr"] Jul 07 15:47:27.959179 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:27.959137 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:28.012343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-envoy\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012494 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188950af-8fcc-4e5d-ae54-18742de397d2-istio-podinfo\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012494 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-certs\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012494 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-istio-token\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012494 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-socket\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-data\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qbh\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-kube-api-access-67qbh\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012652 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188950af-8fcc-4e5d-ae54-18742de397d2-istiod-ca-cert\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.012747 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.012655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-credential-socket\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.057237 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.057206 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:28.113936 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.113899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188950af-8fcc-4e5d-ae54-18742de397d2-istio-podinfo\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.113951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-certs\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.113981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-istio-token\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-socket\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-data\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114131 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qbh\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-kube-api-access-67qbh\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114413 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188950af-8fcc-4e5d-ae54-18742de397d2-istiod-ca-cert\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114413 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-credential-socket\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114413 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-envoy\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114566 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-certs\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114566 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-socket\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114696 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114570 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-data\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.114751 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.114721 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-credential-socket\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.115026 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.115006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188950af-8fcc-4e5d-ae54-18742de397d2-istiod-ca-cert\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.116356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.116336 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-envoy\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.116493 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.116479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188950af-8fcc-4e5d-ae54-18742de397d2-istio-podinfo\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.122679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.122641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qbh\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-kube-api-access-67qbh\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.123235 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.123204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-istio-token\") pod \"e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.243675 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.243574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:28.378998 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.378965 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr"] Jul 07 15:47:28.382045 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:47:28.382013 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188950af_8fcc_4e5d_ae54_18742de397d2.slice/crio-b52ec8f8e890d5edc8296cc93a0c09d9e9c7b3a403ea4b9e9bd196856e7a5395 WatchSource:0}: Error finding container b52ec8f8e890d5edc8296cc93a0c09d9e9c7b3a403ea4b9e9bd196856e7a5395: Status 404 returned error can't find the container with id b52ec8f8e890d5edc8296cc93a0c09d9e9c7b3a403ea4b9e9bd196856e7a5395 Jul 07 15:47:28.385154 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.385110 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:28.385714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.385200 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:28.385714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.385240 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:28.707859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.707796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" event={"ID":"188950af-8fcc-4e5d-ae54-18742de397d2","Type":"ContainerStarted","Data":"819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56"} Jul 07 15:47:28.708039 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.707901 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" event={"ID":"188950af-8fcc-4e5d-ae54-18742de397d2","Type":"ContainerStarted","Data":"b52ec8f8e890d5edc8296cc93a0c09d9e9c7b3a403ea4b9e9bd196856e7a5395"} Jul 07 15:47:28.731680 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:28.731635 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podStartSLOduration=1.731621367 podStartE2EDuration="1.731621367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:28.729270755 +0000 UTC m=+2068.837665877" watchObservedRunningTime="2026-07-07 15:47:28.731621367 +0000 UTC m=+2068.840016493" Jul 07 15:47:29.245849 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:29.245791 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:29.255165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:29.255117 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:29.711662 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:29.711635 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:29.712529 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:29.712511 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:30.730689 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:30.730655 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:30.817503 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:30.817466 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:30.894994 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:30.894962 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:31.029377 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:31.029343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:31.293872 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:31.293757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:31.395028 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:31.394995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:35.234694 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:35.234656 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:36.746666 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:36.746623 2564 generic.go:356] "Generic (PLEG): container finished" podID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerID="76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855" exitCode=0 Jul 07 15:47:36.747231 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:36.746688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" event={"ID":"d68fd0e5-645e-43ae-bae1-4bb34cad721a","Type":"ContainerDied","Data":"76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855"} Jul 07 15:47:36.747231 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:36.747168 2564 scope.go:117] "RemoveContainer" containerID="76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855" Jul 07 15:47:36.748707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:36.748665 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:36.748851 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:36.748761 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:36.748851 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:36.748810 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:37.677714 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:37.677677 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:37.755138 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:37.755081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" event={"ID":"d68fd0e5-645e-43ae-bae1-4bb34cad721a","Type":"ContainerStarted","Data":"d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46"} Jul 07 15:47:37.871843 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:37.871785 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:37.872049 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:37.872003 2564 patch_prober.go:28] interesting pod/e2e-api-a-face20-openshift-default-d57c66665-wlcg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 07 15:47:37.872132 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:37.872053 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 07 15:47:38.871639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:38.871603 2564 patch_prober.go:28] interesting pod/e2e-api-a-face20-openshift-default-d57c66665-wlcg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 07 15:47:38.872033 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:38.871663 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 07 15:47:39.871847 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:39.871786 2564 patch_prober.go:28] interesting pod/e2e-api-a-face20-openshift-default-d57c66665-wlcg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 07 15:47:39.872233 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:39.871926 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 07 15:47:40.871356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:40.871312 2564 patch_prober.go:28] interesting pod/e2e-api-a-face20-openshift-default-d57c66665-wlcg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 07 15:47:40.871540 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:40.871403 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 07 15:47:41.776743 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.776709 2564 generic.go:356] "Generic (PLEG): container finished" podID="188950af-8fcc-4e5d-ae54-18742de397d2" containerID="819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56" exitCode=0 Jul 07 15:47:41.777176 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.776781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" event={"ID":"188950af-8fcc-4e5d-ae54-18742de397d2","Type":"ContainerDied","Data":"819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56"} Jul 07 15:47:41.777176 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.777160 2564 scope.go:117] "RemoveContainer" containerID="819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56" Jul 07 15:47:41.778096 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.778065 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:41.778199 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.778129 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:41.778199 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.778163 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:41.875466 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.875383 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:41.875785 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.875761 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:41.876551 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:41.876533 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:42.782712 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:42.782675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" event={"ID":"188950af-8fcc-4e5d-ae54-18742de397d2","Type":"ContainerStarted","Data":"2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7"} Jul 07 15:47:43.009820 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.009780 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:43.110078 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.109982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:43.248961 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.248912 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:43.249155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.249095 2564 patch_prober.go:28] interesting pod/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 07 15:47:43.249155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.249140 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 07 15:47:43.265331 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.265303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:43.358079 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.358042 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:43.705539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:43.705504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:44.244351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:44.244313 2564 patch_prober.go:28] interesting pod/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 07 15:47:44.244966 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:44.244935 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 07 15:47:44.712467 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:44.712433 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:45.244614 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:45.244565 2564 patch_prober.go:28] interesting pod/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 07 15:47:45.245116 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:45.244639 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 07 15:47:46.244899 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:46.244860 2564 patch_prober.go:28] interesting pod/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 07 15:47:46.245492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:46.245458 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 07 15:47:47.247853 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:47.247803 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:47.248684 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:47.248659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:47:49.646702 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:49.646665 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:49.718158 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:49.718127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:49.884954 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:49.884924 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9"] Jul 07 15:47:49.885158 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:49.885134 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" containerID="cri-o://d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46" gracePeriod=30 Jul 07 15:47:49.909271 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:49.909185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:50.138017 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:50.137986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:50.465126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:50.465096 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:50.842070 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:50.842034 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:50.955014 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:50.954980 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:51.063104 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:51.063073 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:51.274728 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:51.274700 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:55.125522 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.125500 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:55.275362 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275335 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-credential-socket\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275377 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dsw4\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-kube-api-access-5dsw4\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275403 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-socket\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275425 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-data\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275450 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-token\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275474 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istiod-ca-cert\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275523 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275507 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-certs\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275855 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275573 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-envoy\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275855 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275579 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:55.275855 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275613 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-podinfo\") pod \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\" (UID: \"d68fd0e5-645e-43ae-bae1-4bb34cad721a\") " Jul 07 15:47:55.275855 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275762 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:55.276059 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275912 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.276059 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275931 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.276059 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.275913 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:47:55.276203 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.276064 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:55.276371 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.276350 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-data" (OuterVolumeSpecName: "istio-data") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:55.277697 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.277676 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-kube-api-access-5dsw4" (OuterVolumeSpecName: "kube-api-access-5dsw4") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "kube-api-access-5dsw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:55.277782 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.277697 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:47:55.277902 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.277883 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:55.277999 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.277981 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d68fd0e5-645e-43ae-bae1-4bb34cad721a" (UID: "d68fd0e5-645e-43ae-bae1-4bb34cad721a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:55.376966 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.376919 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.376966 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.376960 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.376966 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.376974 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dsw4\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-kube-api-access-5dsw4\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.377201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.376988 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.377201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.376999 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.377201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.377009 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d68fd0e5-645e-43ae-bae1-4bb34cad721a-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.377201 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.377019 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d68fd0e5-645e-43ae-bae1-4bb34cad721a-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:47:55.840408 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.840321 2564 generic.go:356] "Generic (PLEG): container finished" podID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerID="d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46" exitCode=0 Jul 07 15:47:55.840408 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.840379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" event={"ID":"d68fd0e5-645e-43ae-bae1-4bb34cad721a","Type":"ContainerDied","Data":"d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46"} Jul 07 15:47:55.840408 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.840389 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" Jul 07 15:47:55.840677 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.840419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9" event={"ID":"d68fd0e5-645e-43ae-bae1-4bb34cad721a","Type":"ContainerDied","Data":"3e226bdd3633a2764a593414593fe30bf08f0f00ec94de9b96ed25c4fef31320"} Jul 07 15:47:55.840677 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.840440 2564 scope.go:117] "RemoveContainer" containerID="d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46" Jul 07 15:47:55.848577 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.848564 2564 scope.go:117] "RemoveContainer" containerID="76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855" Jul 07 15:47:55.855921 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.855817 2564 scope.go:117] "RemoveContainer" containerID="d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46" Jul 07 15:47:55.856569 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:47:55.856167 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46\": container with ID starting with d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46 not found: ID does not exist" containerID="d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46" Jul 07 15:47:55.856569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.856202 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46"} err="failed to get container status \"d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46\": rpc error: code = NotFound desc = could not find container \"d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46\": container with ID starting with d52ba3a88856a722290b607f57c8b721c298537e4f0eba294f11e33f2f648a46 not found: ID does not exist" Jul 07 15:47:55.856569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.856223 2564 scope.go:117] "RemoveContainer" containerID="76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855" Jul 07 15:47:55.856569 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:47:55.856524 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855\": container with ID starting with 76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855 not found: ID does not exist" containerID="76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855" Jul 07 15:47:55.856569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.856547 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855"} err="failed to get container status \"76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855\": rpc error: code = NotFound desc = could not find container \"76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855\": container with ID starting with 76cfe8b34230a6e48ae0b2d912d8cde1947707e8b82b4b7e76f95d5ef54d9855 not found: ID does not exist" Jul 07 15:47:55.858305 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.857972 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9"] Jul 07 15:47:55.880722 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:55.880697 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-face20-openshift-default-d57c66665-wlcg9"] Jul 07 15:47:57.087371 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.087335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:57.153968 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.153935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:57.322103 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.322072 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr"] Jul 07 15:47:57.322372 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.322347 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" containerID="cri-o://2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7" gracePeriod=30 Jul 07 15:47:57.344442 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.344358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:57.521635 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.521602 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" path="/var/lib/kubelet/pods/d68fd0e5-645e-43ae-bae1-4bb34cad721a/volumes" Jul 07 15:47:57.598631 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.598538 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:57.918375 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:57.918287 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:58.182488 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.182405 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz"] Jul 07 15:47:58.182815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.182677 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" Jul 07 15:47:58.182815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.182687 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" Jul 07 15:47:58.182815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.182746 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" Jul 07 15:47:58.182815 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.182754 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" Jul 07 15:47:58.185536 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.185518 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.187791 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.187772 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1f2ee2-openshift-default-dockercfg-rwr6f\"" Jul 07 15:47:58.196312 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.196291 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz"] Jul 07 15:47:58.207240 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.207215 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:58.299753 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-istio-token\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.299753 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8144c82a-0103-4729-9144-29999475b80c-istiod-ca-cert\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.299974 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-certs\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.299974 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5kl\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-kube-api-access-dh5kl\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.299974 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-credential-socket\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.299974 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-envoy\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.300129 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-data\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.300129 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.299998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8144c82a-0103-4729-9144-29999475b80c-istio-podinfo\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.300129 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.300040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-socket\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.397531 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.397498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:58.400546 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-certs\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400674 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5kl\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-kube-api-access-dh5kl\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400674 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-credential-socket\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400674 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-envoy\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-data\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8144c82a-0103-4729-9144-29999475b80c-istio-podinfo\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-socket\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-istio-token\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.400859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8144c82a-0103-4729-9144-29999475b80c-istiod-ca-cert\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.401107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.400981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-certs\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.401107 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.401047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-credential-socket\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.401210 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.401196 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-data\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.401270 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.401237 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-socket\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.401524 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.401503 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8144c82a-0103-4729-9144-29999475b80c-istiod-ca-cert\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.402919 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.402891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-envoy\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.403237 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.403213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8144c82a-0103-4729-9144-29999475b80c-istio-podinfo\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.408502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.408484 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-istio-token\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.408861 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.408841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5kl\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-kube-api-access-dh5kl\") pod \"e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.495945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.495859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:58.625499 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.625477 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz"] Jul 07 15:47:58.627756 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:47:58.627729 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8144c82a_0103_4729_9144_29999475b80c.slice/crio-f48039aa6cd10a18dea0676d3510e149064d2bef9d2dd6d6bde2628c839b64c3 WatchSource:0}: Error finding container f48039aa6cd10a18dea0676d3510e149064d2bef9d2dd6d6bde2628c839b64c3: Status 404 returned error can't find the container with id f48039aa6cd10a18dea0676d3510e149064d2bef9d2dd6d6bde2628c839b64c3 Jul 07 15:47:58.629819 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.629790 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:58.629931 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.629911 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:58.629989 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.629959 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:58.856446 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.856411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" event={"ID":"8144c82a-0103-4729-9144-29999475b80c","Type":"ContainerStarted","Data":"5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742"} Jul 07 15:47:58.856644 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.856471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" event={"ID":"8144c82a-0103-4729-9144-29999475b80c","Type":"ContainerStarted","Data":"f48039aa6cd10a18dea0676d3510e149064d2bef9d2dd6d6bde2628c839b64c3"} Jul 07 15:47:58.877470 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:58.877420 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podStartSLOduration=0.87740369 podStartE2EDuration="877.40369ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:58.876669572 +0000 UTC m=+2098.985064698" watchObservedRunningTime="2026-07-07 15:47:58.87740369 +0000 UTC m=+2098.985798825" Jul 07 15:47:59.496359 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:59.496325 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:59.500978 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:59.500954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:59.861288 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:59.861258 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:47:59.862253 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:47:59.862233 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:48:00.969290 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:00.969257 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:01.050415 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:01.050385 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:01.116349 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:01.116312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:01.334409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:01.334380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:01.690593 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:01.690507 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:01.791031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:01.790999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:02.251187 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.251147 2564 patch_prober.go:28] interesting pod/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 07 15:48:02.251559 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.251207 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:48:02.569176 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.569153 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:48:02.742498 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742466 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-istio-token\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.742704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742509 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188950af-8fcc-4e5d-ae54-18742de397d2-istio-podinfo\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.742704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742542 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-envoy\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.742704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742595 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-socket\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.742704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742635 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188950af-8fcc-4e5d-ae54-18742de397d2-istiod-ca-cert\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.742704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742661 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67qbh\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-kube-api-access-67qbh\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.742704 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742686 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-credential-socket\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.743036 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742745 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-data\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.743036 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742773 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-certs\") pod \"188950af-8fcc-4e5d-ae54-18742de397d2\" (UID: \"188950af-8fcc-4e5d-ae54-18742de397d2\") " Jul 07 15:48:02.743036 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.742962 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:48:02.743190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743051 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/188950af-8fcc-4e5d-ae54-18742de397d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:48:02.743190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743063 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:48:02.743306 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743207 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:48:02.743306 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743222 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.743306 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743244 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.743306 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743260 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188950af-8fcc-4e5d-ae54-18742de397d2-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.743718 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.743697 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:48:02.744863 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.744818 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:48:02.744995 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.744974 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:48:02.745156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.745134 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/188950af-8fcc-4e5d-ae54-18742de397d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:48:02.745156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.745145 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-kube-api-access-67qbh" (OuterVolumeSpecName: "kube-api-access-67qbh") pod "188950af-8fcc-4e5d-ae54-18742de397d2" (UID: "188950af-8fcc-4e5d-ae54-18742de397d2"). InnerVolumeSpecName "kube-api-access-67qbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:48:02.844369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.844285 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188950af-8fcc-4e5d-ae54-18742de397d2-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.844369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.844312 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.844369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.844320 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67qbh\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-kube-api-access-67qbh\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.844369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.844328 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.844369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.844338 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188950af-8fcc-4e5d-ae54-18742de397d2-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.844369 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.844349 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188950af-8fcc-4e5d-ae54-18742de397d2-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:48:02.875169 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.875140 2564 generic.go:356] "Generic (PLEG): container finished" podID="188950af-8fcc-4e5d-ae54-18742de397d2" containerID="2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7" exitCode=0 Jul 07 15:48:02.875352 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.875188 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" Jul 07 15:48:02.875352 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.875228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" event={"ID":"188950af-8fcc-4e5d-ae54-18742de397d2","Type":"ContainerDied","Data":"2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7"} Jul 07 15:48:02.875352 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.875303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr" event={"ID":"188950af-8fcc-4e5d-ae54-18742de397d2","Type":"ContainerDied","Data":"b52ec8f8e890d5edc8296cc93a0c09d9e9c7b3a403ea4b9e9bd196856e7a5395"} Jul 07 15:48:02.875352 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.875330 2564 scope.go:117] "RemoveContainer" containerID="2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7" Jul 07 15:48:02.883811 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.883796 2564 scope.go:117] "RemoveContainer" containerID="819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56" Jul 07 15:48:02.891031 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.891012 2564 scope.go:117] "RemoveContainer" containerID="2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7" Jul 07 15:48:02.891259 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:48:02.891240 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7\": container with ID starting with 2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7 not found: ID does not exist" containerID="2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7" Jul 07 15:48:02.891334 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.891270 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7"} err="failed to get container status \"2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7\": rpc error: code = NotFound desc = could not find container \"2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7\": container with ID starting with 2d9bfd430f8d8aab0bb2dea9da270c47a546efd30e34f979118233a5624fb0f7 not found: ID does not exist" Jul 07 15:48:02.891334 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.891291 2564 scope.go:117] "RemoveContainer" containerID="819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56" Jul 07 15:48:02.891528 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:48:02.891510 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56\": container with ID starting with 819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56 not found: ID does not exist" containerID="819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56" Jul 07 15:48:02.891569 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.891534 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56"} err="failed to get container status \"819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56\": rpc error: code = NotFound desc = could not find container \"819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56\": container with ID starting with 819f8086519a8ab79e95deeffa945357cb037dc99e171615b0311e7987c50b56 not found: ID does not exist" Jul 07 15:48:02.895920 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.895899 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr"] Jul 07 15:48:02.902612 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:02.902593 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7c4422-openshift-default-f755ff56f-bf2fr"] Jul 07 15:48:03.522040 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:03.522010 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" path="/var/lib/kubelet/pods/188950af-8fcc-4e5d-ae54-18742de397d2/volumes" Jul 07 15:48:05.381317 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:05.381287 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:05.780567 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:05.780533 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:06.012691 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.012658 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn"] Jul 07 15:48:06.012974 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.012962 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" Jul 07 15:48:06.013028 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.012976 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" Jul 07 15:48:06.013028 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.012993 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" Jul 07 15:48:06.013028 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.012998 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68fd0e5-645e-43ae-bae1-4bb34cad721a" containerName="istio-proxy" Jul 07 15:48:06.013136 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.013062 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" Jul 07 15:48:06.013136 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.013072 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" Jul 07 15:48:06.014936 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.014919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.018078 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.018054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-458f34-openshift-default-dockercfg-dm9mt\"" Jul 07 15:48:06.030308 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.030289 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn"] Jul 07 15:48:06.041899 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.041840 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:06.074062 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-socket\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-credential-socket\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-certs\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-data\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074190 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074146 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-podinfo\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94082f1-25b9-495d-9c90-d317fc3afaf5-istiod-ca-cert\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4n2r\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-kube-api-access-w4n2r\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-envoy\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.074453 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.074348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-token\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175495 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94082f1-25b9-495d-9c90-d317fc3afaf5-istiod-ca-cert\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4n2r\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-kube-api-access-w4n2r\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-envoy\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-token\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-socket\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-credential-socket\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-certs\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-data\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.175707 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.175665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-podinfo\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.176351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.176009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-socket\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.176351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.176042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-credential-socket\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.176351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.176083 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-certs\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.176351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.176194 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-data\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.176351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.176294 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94082f1-25b9-495d-9c90-d317fc3afaf5-istiod-ca-cert\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.177753 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.177720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-envoy\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.177978 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.177960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-podinfo\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.184041 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.184019 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4n2r\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-kube-api-access-w4n2r\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.184041 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.184035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-token\") pod \"e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.324344 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.324257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:06.392225 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.392164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:06.454337 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.454202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn"] Jul 07 15:48:06.456807 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:48:06.456779 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94082f1_25b9_495d_9c90_d317fc3afaf5.slice/crio-865f80282b781389816d18abfe2e7117711672f247894d6c723783323883bb55 WatchSource:0}: Error finding container 865f80282b781389816d18abfe2e7117711672f247894d6c723783323883bb55: Status 404 returned error can't find the container with id 865f80282b781389816d18abfe2e7117711672f247894d6c723783323883bb55 Jul 07 15:48:06.459078 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.459044 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:06.459156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.459121 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:06.459205 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.459164 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:06.893269 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.893231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" event={"ID":"c94082f1-25b9-495d-9c90-d317fc3afaf5","Type":"ContainerStarted","Data":"4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d"} Jul 07 15:48:06.893468 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.893310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" event={"ID":"c94082f1-25b9-495d-9c90-d317fc3afaf5","Type":"ContainerStarted","Data":"865f80282b781389816d18abfe2e7117711672f247894d6c723783323883bb55"} Jul 07 15:48:06.914472 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:06.914422 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podStartSLOduration=1.914406871 podStartE2EDuration="1.914406871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:06.913017526 +0000 UTC m=+2107.021412652" watchObservedRunningTime="2026-07-07 15:48:06.914406871 +0000 UTC m=+2107.022801995" Jul 07 15:48:07.325475 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:07.325439 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:07.329755 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:07.329733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:07.897561 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:07.897521 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:07.898529 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:07.898513 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:08.892575 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:08.892536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:08.992879 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:08.992847 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:09.102759 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:09.102728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:09.567233 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:09.567203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:09.668194 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:09.668163 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:13.376271 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:13.376234 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:15.642166 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.642137 2564 patch_prober.go:28] interesting pod/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": read tcp 10.132.0.2:39464->10.132.0.31:15021: read: connection reset by peer" start-of-body= Jul 07 15:48:15.642669 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.642640 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": read tcp 10.132.0.2:39464->10.132.0.31:15021: read: connection reset by peer" Jul 07 15:48:15.932602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.932501 2564 generic.go:356] "Generic (PLEG): container finished" podID="8144c82a-0103-4729-9144-29999475b80c" containerID="5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742" exitCode=0 Jul 07 15:48:15.932602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.932572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" event={"ID":"8144c82a-0103-4729-9144-29999475b80c","Type":"ContainerDied","Data":"5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742"} Jul 07 15:48:15.932968 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.932955 2564 scope.go:117] "RemoveContainer" containerID="5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742" Jul 07 15:48:15.933958 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.933934 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:15.934021 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.934000 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:15.934073 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:15.934061 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:16.941603 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:16.941559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" event={"ID":"8144c82a-0103-4729-9144-29999475b80c","Type":"ContainerStarted","Data":"e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489"} Jul 07 15:48:17.496616 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:17.496574 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:48:17.496792 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:17.496682 2564 patch_prober.go:28] interesting pod/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 15:48:17.496792 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:17.496715 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 15:48:18.497219 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:18.497178 2564 patch_prober.go:28] interesting pod/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 15:48:18.497620 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:18.497232 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 15:48:19.497144 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:19.497114 2564 patch_prober.go:28] interesting pod/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 15:48:19.497249 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:19.497184 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 15:48:20.497334 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:20.497293 2564 patch_prober.go:28] interesting pod/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 15:48:20.497860 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:20.497350 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 15:48:21.470040 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:21.470005 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:21.500470 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:21.500434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:48:21.500962 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:21.500688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:48:21.501447 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:21.501426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:48:22.899547 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.899511 2564 patch_prober.go:28] interesting pod/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 07 15:48:22.899976 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.899577 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 07 15:48:22.937434 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.937402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:22.972957 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.972933 2564 generic.go:356] "Generic (PLEG): container finished" podID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerID="4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d" exitCode=0 Jul 07 15:48:22.973063 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.973006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" event={"ID":"c94082f1-25b9-495d-9c90-d317fc3afaf5","Type":"ContainerDied","Data":"4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d"} Jul 07 15:48:22.973470 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.973456 2564 scope.go:117] "RemoveContainer" containerID="4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d" Jul 07 15:48:22.974483 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.974450 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:22.974546 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.974530 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:22.974592 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:22.974579 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:48:23.978557 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:23.978525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" event={"ID":"c94082f1-25b9-495d-9c90-d317fc3afaf5","Type":"ContainerStarted","Data":"05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783"} Jul 07 15:48:24.325211 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:24.325181 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:24.325382 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:24.325340 2564 patch_prober.go:28] interesting pod/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 07 15:48:24.325425 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:24.325392 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 07 15:48:25.325618 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:25.325577 2564 patch_prober.go:28] interesting pod/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 07 15:48:25.326111 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:25.325637 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 07 15:48:26.325414 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:26.325374 2564 patch_prober.go:28] interesting pod/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 07 15:48:26.325629 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:26.325437 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 07 15:48:27.325619 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:27.325581 2564 patch_prober.go:28] interesting pod/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 07 15:48:27.326149 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:27.325651 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 07 15:48:28.328357 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:28.328331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:28.328795 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:28.328609 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:28.329282 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:28.329265 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:48:30.295980 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:30.295952 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:30.393792 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:30.393760 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:54.563953 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:48:54.563919 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:03.601493 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:49:03.601458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:51.869513 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:50:51.869455 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:52.686997 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:50:52.686960 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:02.655351 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:51:02.655313 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:02.858958 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:51:02.858924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:02.933455 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:51:02.933384 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:27.760893 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:51:27.760854 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:05.164948 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:52:05.164914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:06.098173 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:52:06.098119 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:09.162126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:52:09.162097 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:43.728922 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:52:43.728889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:43.831165 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:52:43.831134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:50.375104 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:52:50.375068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:23.214604 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:23.214566 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:24.371324 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:24.371291 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:31.109551 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:31.109515 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:31.215206 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:31.215174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:32.331232 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:32.331203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:33.285848 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:33.285801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:34.392463 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:34.392432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:34.817615 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:34.817581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:34.916082 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:34.916049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:35.014029 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:35.013994 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:35.176936 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:35.176855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:39.887015 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:39.886981 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:40.235850 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:53:40.235744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:17.357436 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:17.357400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:17.581228 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:17.581194 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz"] Jul 07 15:54:17.581482 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:17.581434 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" containerID="cri-o://e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489" gracePeriod=30 Jul 07 15:54:17.674525 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:17.674426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:17.842414 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:17.842380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:18.034627 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:18.034596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:18.472358 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:18.472269 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:18.590244 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:18.590216 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:18.796126 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:18.796093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:21.503525 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:21.503486 2564 patch_prober.go:28] interesting pod/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 15:54:21.503961 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:21.503557 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:54:22.817749 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.817726 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:54:22.841489 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841424 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8144c82a-0103-4729-9144-29999475b80c-istiod-ca-cert\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841489 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841472 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-data\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841503 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-envoy\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841520 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8144c82a-0103-4729-9144-29999475b80c-istio-podinfo\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841538 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-socket\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841564 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-certs\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841587 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-credential-socket\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841679 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841618 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-istio-token\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841932 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841683 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh5kl\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-kube-api-access-dh5kl\") pod \"8144c82a-0103-4729-9144-29999475b80c\" (UID: \"8144c82a-0103-4729-9144-29999475b80c\") " Jul 07 15:54:22.841932 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841815 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:22.842048 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841938 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.842048 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841941 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:22.842048 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.841957 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8144c82a-0103-4729-9144-29999475b80c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:54:22.842255 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.842150 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:22.842313 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.842294 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:22.843788 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.843762 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-kube-api-access-dh5kl" (OuterVolumeSpecName: "kube-api-access-dh5kl") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "kube-api-access-dh5kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:54:22.843788 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.843771 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8144c82a-0103-4729-9144-29999475b80c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:54:22.844292 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.844267 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:54:22.844392 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.844267 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8144c82a-0103-4729-9144-29999475b80c" (UID: "8144c82a-0103-4729-9144-29999475b80c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:22.942852 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942787 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.942852 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942820 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.942852 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942854 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8144c82a-0103-4729-9144-29999475b80c-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.942852 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942863 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.943132 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942872 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8144c82a-0103-4729-9144-29999475b80c-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.943132 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942882 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.943132 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942891 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh5kl\" (UniqueName: \"kubernetes.io/projected/8144c82a-0103-4729-9144-29999475b80c-kube-api-access-dh5kl\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:22.943132 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:22.942901 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8144c82a-0103-4729-9144-29999475b80c-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:23.448398 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.448367 2564 generic.go:356] "Generic (PLEG): container finished" podID="8144c82a-0103-4729-9144-29999475b80c" containerID="e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489" exitCode=0 Jul 07 15:54:23.448573 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.448416 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" Jul 07 15:54:23.448573 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.448420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" event={"ID":"8144c82a-0103-4729-9144-29999475b80c","Type":"ContainerDied","Data":"e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489"} Jul 07 15:54:23.448573 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.448534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz" event={"ID":"8144c82a-0103-4729-9144-29999475b80c","Type":"ContainerDied","Data":"f48039aa6cd10a18dea0676d3510e149064d2bef9d2dd6d6bde2628c839b64c3"} Jul 07 15:54:23.448573 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.448563 2564 scope.go:117] "RemoveContainer" containerID="e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489" Jul 07 15:54:23.457321 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.457305 2564 scope.go:117] "RemoveContainer" containerID="5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742" Jul 07 15:54:23.464640 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.464611 2564 scope.go:117] "RemoveContainer" containerID="e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489" Jul 07 15:54:23.464927 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:54:23.464901 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489\": container with ID starting with e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489 not found: ID does not exist" containerID="e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489" Jul 07 15:54:23.465024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.464938 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489"} err="failed to get container status \"e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489\": rpc error: code = NotFound desc = could not find container \"e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489\": container with ID starting with e95855f035d218f532d222131492efca7beea53b623d759e9fc40cde1a86c489 not found: ID does not exist" Jul 07 15:54:23.465024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.464964 2564 scope.go:117] "RemoveContainer" containerID="5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742" Jul 07 15:54:23.465213 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:54:23.465196 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742\": container with ID starting with 5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742 not found: ID does not exist" containerID="5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742" Jul 07 15:54:23.465252 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.465218 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742"} err="failed to get container status \"5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742\": rpc error: code = NotFound desc = could not find container \"5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742\": container with ID starting with 5b847eeffdafc8dbeae9863d81448cd285b5a1a8736e1b58282a8b478a7bf742 not found: ID does not exist" Jul 07 15:54:23.472033 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.472010 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz"] Jul 07 15:54:23.474729 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.474709 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1f2ee2-openshift-default-85df644559-pqqbz"] Jul 07 15:54:23.526749 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:23.526717 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8144c82a-0103-4729-9144-29999475b80c" path="/var/lib/kubelet/pods/8144c82a-0103-4729-9144-29999475b80c/volumes" Jul 07 15:54:25.561950 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:25.561913 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:25.636398 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:25.636370 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:25.827343 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:25.827256 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn"] Jul 07 15:54:25.827503 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:25.827451 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" containerID="cri-o://05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783" gracePeriod=30 Jul 07 15:54:25.841180 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:25.841157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:26.086693 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:26.086608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:27.982849 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:27.982806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:28.330733 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:28.330697 2564 patch_prober.go:28] interesting pod/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 15:54:28.330908 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:28.330764 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:54:31.067296 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.067271 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:54:31.106999 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.106930 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-socket\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.106999 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.106981 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-token\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-credential-socket\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107039 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-data\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107077 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94082f1-25b9-495d-9c90-d317fc3afaf5-istiod-ca-cert\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107109 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4n2r\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-kube-api-access-w4n2r\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107136 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-envoy\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107177 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107171 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-certs\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107212 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-podinfo\") pod \"c94082f1-25b9-495d-9c90-d317fc3afaf5\" (UID: \"c94082f1-25b9-495d-9c90-d317fc3afaf5\") " Jul 07 15:54:31.107492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107256 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:31.107492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107364 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:31.107492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107466 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94082f1-25b9-495d-9c90-d317fc3afaf5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:54:31.107492 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107479 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-credential-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.107753 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107497 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-socket\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.107753 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107722 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:31.108021 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.107985 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:31.109539 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.109510 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-kube-api-access-w4n2r" (OuterVolumeSpecName: "kube-api-access-w4n2r") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "kube-api-access-w4n2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:54:31.109709 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.109691 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 15:54:31.109805 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.109787 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:54:31.109886 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.109813 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c94082f1-25b9-495d-9c90-d317fc3afaf5" (UID: "c94082f1-25b9-495d-9c90-d317fc3afaf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:54:31.208155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208122 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.208155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208150 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94082f1-25b9-495d-9c90-d317fc3afaf5-istiod-ca-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.208155 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208159 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4n2r\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-kube-api-access-w4n2r\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.208379 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208167 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-envoy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.208379 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208176 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94082f1-25b9-495d-9c90-d317fc3afaf5-workload-certs\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.208379 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208183 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-podinfo\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.208379 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.208190 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94082f1-25b9-495d-9c90-d317fc3afaf5-istio-token\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 07 15:54:31.481905 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.481808 2564 generic.go:356] "Generic (PLEG): container finished" podID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerID="05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783" exitCode=0 Jul 07 15:54:31.481905 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.481885 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" Jul 07 15:54:31.482140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.481897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" event={"ID":"c94082f1-25b9-495d-9c90-d317fc3afaf5","Type":"ContainerDied","Data":"05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783"} Jul 07 15:54:31.482140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.481963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn" event={"ID":"c94082f1-25b9-495d-9c90-d317fc3afaf5","Type":"ContainerDied","Data":"865f80282b781389816d18abfe2e7117711672f247894d6c723783323883bb55"} Jul 07 15:54:31.482140 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.481994 2564 scope.go:117] "RemoveContainer" containerID="05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783" Jul 07 15:54:31.496057 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.496037 2564 scope.go:117] "RemoveContainer" containerID="4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d" Jul 07 15:54:31.503505 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.503487 2564 scope.go:117] "RemoveContainer" containerID="05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783" Jul 07 15:54:31.503746 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:54:31.503726 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783\": container with ID starting with 05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783 not found: ID does not exist" containerID="05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783" Jul 07 15:54:31.503808 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.503758 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783"} err="failed to get container status \"05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783\": rpc error: code = NotFound desc = could not find container \"05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783\": container with ID starting with 05be3be993ea9c5e9c567809f737a536b05470c07bcb7a3e867cf33e7a0c3783 not found: ID does not exist" Jul 07 15:54:31.503808 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.503780 2564 scope.go:117] "RemoveContainer" containerID="4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d" Jul 07 15:54:31.504020 ip-10-0-140-125 kubenswrapper[2564]: E0707 15:54:31.504001 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d\": container with ID starting with 4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d not found: ID does not exist" containerID="4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d" Jul 07 15:54:31.504090 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.504028 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d"} err="failed to get container status \"4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d\": rpc error: code = NotFound desc = could not find container \"4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d\": container with ID starting with 4b2896bc94a452dabb1b8f0cf244f47d6f0cb5b34a8892d7c59f5cd0a6a4c52d not found: ID does not exist" Jul 07 15:54:31.511701 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.511679 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn"] Jul 07 15:54:31.521431 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:31.521411 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-458f34-openshift-default-7c8d547f9-jtnjn"] Jul 07 15:54:32.053664 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:32.053637 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcbf69668-pgln8_a2c9a3e6-9723-47af-95dc-e6c584662dac/copy-manifests/0.log" Jul 07 15:54:32.062074 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:32.062052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcbf69668-pgln8_a2c9a3e6-9723-47af-95dc-e6c584662dac/manager/0.log" Jul 07 15:54:33.521000 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:33.520973 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" path="/var/lib/kubelet/pods/c94082f1-25b9-495d-9c90-d317fc3afaf5/volumes" Jul 07 15:54:34.851599 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:34.851564 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784wswx_f0e3dfc4-7e6a-4715-ab92-2c4278ea068a/istio-proxy/0.log" Jul 07 15:54:34.964897 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:34.964871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fxcb7_fe9a0d3c-587b-4774-acc2-5465e7377f5f/discovery/0.log" Jul 07 15:54:35.326154 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:35.326127 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/1.log" Jul 07 15:54:36.128840 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:36.128811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-l9mbl_92e14013-0b71-447b-8239-ed473212a478/main/0.log" Jul 07 15:54:36.473766 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:36.473689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zs9b4_17b3f0c8-54d0-4ec5-bdbb-cec4d18a76d3/main/0.log" Jul 07 15:54:40.516247 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:40.516208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:40.610345 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:40.610303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:41.454900 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:41.454866 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:41.556026 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:41.555996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:43.737297 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:43.737268 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kslrs_31a1df73-0abf-416a-bbff-6a72f6419abc/global-pull-secret-syncer/0.log" Jul 07 15:54:43.845602 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:43.845573 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7v999_c0548311-bdd8-42f1-ace0-31df79383ef3/konnectivity-agent/0.log" Jul 07 15:54:44.045327 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:44.045297 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-125.ec2.internal_73d7c4a409d43abc3672000c2f9d10d0/haproxy/0.log" Jul 07 15:54:52.060979 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:52.060902 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-46qbr_383ab718-a299-44d0-906d-09c3cd3014ae/monitoring-plugin/0.log" Jul 07 15:54:52.269920 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:52.269889 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2426_11a9f890-ef52-45fd-88e3-2fadb709e8df/node-exporter/0.log" Jul 07 15:54:52.301221 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:52.301191 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2426_11a9f890-ef52-45fd-88e3-2fadb709e8df/kube-rbac-proxy/0.log" Jul 07 15:54:52.326449 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:52.326377 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2426_11a9f890-ef52-45fd-88e3-2fadb709e8df/init-textfile/0.log" Jul 07 15:54:53.632262 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632232 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx"] Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632508 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632519 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632533 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632538 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="188950af-8fcc-4e5d-ae54-18742de397d2" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632545 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632550 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632560 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632565 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632630 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8144c82a-0103-4729-9144-29999475b80c" containerName="istio-proxy" Jul 07 15:54:53.632639 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.632638 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c94082f1-25b9-495d-9c90-d317fc3afaf5" containerName="istio-proxy" Jul 07 15:54:53.635502 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.635471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.638244 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.638220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvtd8\"/\"kube-root-ca.crt\"" Jul 07 15:54:53.638356 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.638225 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wvtd8\"/\"default-dockercfg-4d48b\"" Jul 07 15:54:53.639082 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.639065 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvtd8\"/\"openshift-service-ca.crt\"" Jul 07 15:54:53.661907 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.659321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx"] Jul 07 15:54:53.792741 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.792690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-lib-modules\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.792945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.792771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz5ds\" (UniqueName: \"kubernetes.io/projected/49580776-8f9c-467f-b707-08cbba189b6f-kube-api-access-pz5ds\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.792945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.792810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-sys\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.792945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.792854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-proc\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.792945 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.792926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-podres\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.893859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz5ds\" (UniqueName: \"kubernetes.io/projected/49580776-8f9c-467f-b707-08cbba189b6f-kube-api-access-pz5ds\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.893859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-sys\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.893859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-proc\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.893859 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-podres\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.894156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893922 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-sys\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.894156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-proc\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.894156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.893954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-lib-modules\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.894156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.894065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-lib-modules\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.894156 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.894064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49580776-8f9c-467f-b707-08cbba189b6f-podres\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.909584 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.909550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz5ds\" (UniqueName: \"kubernetes.io/projected/49580776-8f9c-467f-b707-08cbba189b6f-kube-api-access-pz5ds\") pod \"perf-node-gather-daemonset-b5scx\" (UID: \"49580776-8f9c-467f-b707-08cbba189b6f\") " pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:53.944675 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:53.944656 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:54.097293 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:54.097261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx"] Jul 07 15:54:54.100168 ip-10-0-140-125 kubenswrapper[2564]: W0707 15:54:54.100140 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49580776_8f9c_467f_b707_08cbba189b6f.slice/crio-0b9832d70cdea7a6e0c61b3a4d7715b8fa0104718c1cb7f7c30a172201a4e2f2 WatchSource:0}: Error finding container 0b9832d70cdea7a6e0c61b3a4d7715b8fa0104718c1cb7f7c30a172201a4e2f2: Status 404 returned error can't find the container with id 0b9832d70cdea7a6e0c61b3a4d7715b8fa0104718c1cb7f7c30a172201a4e2f2 Jul 07 15:54:54.585582 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:54.585544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" event={"ID":"49580776-8f9c-467f-b707-08cbba189b6f","Type":"ContainerStarted","Data":"172341f0d5b5a0f660c7f9049848786baf67bcd4fa2e029612bae8b2ab1587cf"} Jul 07 15:54:54.585766 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:54.585605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" event={"ID":"49580776-8f9c-467f-b707-08cbba189b6f","Type":"ContainerStarted","Data":"0b9832d70cdea7a6e0c61b3a4d7715b8fa0104718c1cb7f7c30a172201a4e2f2"} Jul 07 15:54:54.585766 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:54.585657 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:54:54.604234 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:54.604190 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" podStartSLOduration=1.604176292 podStartE2EDuration="1.604176292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:54:54.603365313 +0000 UTC m=+2514.711760440" watchObservedRunningTime="2026-07-07 15:54:54.604176292 +0000 UTC m=+2514.712571417" Jul 07 15:54:57.311265 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:57.311236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cf4nq_4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5/dns/0.log" Jul 07 15:54:57.339463 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:57.339442 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cf4nq_4c0b46b9-9b56-4ffd-bb9b-2928cf0620b5/kube-rbac-proxy/0.log" Jul 07 15:54:57.460219 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:57.460188 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gg2qn_8f966d03-c5f8-4060-9710-9e395755005b/dns-node-resolver/0.log" Jul 07 15:54:58.191902 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:58.191868 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b7d56df6c-bkzqw_9d4cd0b5-afb5-46c2-97c4-16dd44d68ac8/registry/0.log" Jul 07 15:54:58.297637 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:58.297611 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsnkl_d63fd4d5-a176-458a-8da3-50eb960edd95/node-ca/0.log" Jul 07 15:54:59.408225 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:59.408194 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784wswx_f0e3dfc4-7e6a-4715-ab92-2c4278ea068a/istio-proxy/0.log" Jul 07 15:54:59.526024 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:59.525998 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fxcb7_fe9a0d3c-587b-4774-acc2-5465e7377f5f/discovery/0.log" Jul 07 15:54:59.646664 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:59.646631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/0.log" Jul 07 15:54:59.677982 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:54:59.677914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/1.log" Jul 07 15:55:00.566292 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:00.566262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-57qh7_1c5be46a-d362-49e4-9493-6e5a11879a86/serve-healthcheck-canary/0.log" Jul 07 15:55:00.598549 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:00.598521 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wvtd8/perf-node-gather-daemonset-b5scx" Jul 07 15:55:01.279990 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:01.279963 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmkr5_0d8d1282-8e61-4b59-8fc1-5b8720c45209/kube-rbac-proxy/0.log" Jul 07 15:55:01.330303 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:01.330279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmkr5_0d8d1282-8e61-4b59-8fc1-5b8720c45209/exporter/0.log" Jul 07 15:55:01.377937 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:01.377912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmkr5_0d8d1282-8e61-4b59-8fc1-5b8720c45209/extractor/0.log" Jul 07 15:55:04.303409 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:04.303382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784wswx_f0e3dfc4-7e6a-4715-ab92-2c4278ea068a/istio-proxy/0.log" Jul 07 15:55:04.420540 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:04.420505 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fxcb7_fe9a0d3c-587b-4774-acc2-5465e7377f5f/discovery/0.log" Jul 07 15:55:04.564328 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:04.564248 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/0.log" Jul 07 15:55:04.591484 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:04.591458 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/1.log" Jul 07 15:55:05.214933 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:05.214845 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcbf69668-pgln8_a2c9a3e6-9723-47af-95dc-e6c584662dac/manager/0.log" Jul 07 15:55:05.250573 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:05.250548 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcbf69668-pgln8_a2c9a3e6-9723-47af-95dc-e6c584662dac/copy-manifests/0.log" Jul 07 15:55:06.100861 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:06.100814 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784wswx_f0e3dfc4-7e6a-4715-ab92-2c4278ea068a/istio-proxy/0.log" Jul 07 15:55:06.199109 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:06.199076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fxcb7_fe9a0d3c-587b-4774-acc2-5465e7377f5f/discovery/0.log" Jul 07 15:55:06.256214 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:06.256184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/0.log" Jul 07 15:55:06.286653 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:06.286625 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-k4s6n_eda5f1fc-5d79-4e3c-9b08-a5c120490c8f/istio-proxy/1.log" Jul 07 15:55:06.940043 ip-10-0-140-125 kubenswrapper[2564]: I0707 15:55:06.940011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5ffd868d8b-52qm6_e63b747e-cd54-4134-bf7d-1d4be4c2ea2c/manager/0.log"