Jul 06 01:18:21.219239 ip-10-0-134-152 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 01:18:21.219254 ip-10-0-134-152 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 01:18:21.219264 ip-10-0-134-152 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 01:18:21.219613 ip-10-0-134-152 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 01:18:31.299903 ip-10-0-134-152 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 01:18:31.299918 ip-10-0-134-152 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 61a4f746c70144a1b5f98da270bfcc16 -- Jul 06 01:20:08.467240 ip-10-0-134-152 systemd[1]: Starting Kubernetes Kubelet... Jul 06 01:20:08.875658 ip-10-0-134-152 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 01:20:08.876129 ip-10-0-134-152 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 01:20:08.876129 ip-10-0-134-152 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 01:20:08.876129 ip-10-0-134-152 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 01:20:08.876129 ip-10-0-134-152 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 01:20:08.878508 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.878414 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 01:20:08.882850 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882832 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 01:20:08.882850 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882850 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882854 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882858 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882860 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882863 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882866 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882868 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882871 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882875 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882877 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882880 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882883 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882885 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882888 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882891 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882894 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882896 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882899 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882909 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 01:20:08.882915 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882911 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882914 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882917 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882920 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882923 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882926 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882929 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882931 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882934 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882936 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882939 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882954 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882957 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882959 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882962 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882965 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882967 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882969 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882972 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882975 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 01:20:08.883400 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882977 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882980 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882982 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882985 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882989 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882993 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.882997 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883000 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883003 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883007 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883009 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883013 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883015 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883017 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883021 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883024 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883028 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883032 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883035 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 01:20:08.883888 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883038 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883040 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883043 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883045 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883048 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883050 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883054 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883057 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883059 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883061 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883064 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883067 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883069 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883072 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883074 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883077 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883080 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883082 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883085 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883087 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 01:20:08.884359 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883090 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883092 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883095 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883097 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883099 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883104 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883107 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883111 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883114 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883117 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883120 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883123 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883125 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883128 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883131 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883133 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883135 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883138 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883141 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883143 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 01:20:08.884825 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883867 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883874 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883878 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883881 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883884 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883887 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883890 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883892 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883895 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883898 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883901 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883903 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883906 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883908 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883911 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883914 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883916 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883919 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883922 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883926 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 01:20:08.885348 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883929 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883932 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883934 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883937 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883939 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883956 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883959 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883962 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883964 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883967 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883970 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883972 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883975 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883979 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883983 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883986 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883989 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883992 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883995 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 01:20:08.885873 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.883998 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884001 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884004 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884007 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884010 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884012 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884015 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884018 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884020 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884022 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884025 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884028 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884035 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884037 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884040 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884042 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884045 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884048 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884050 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884052 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 01:20:08.886354 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884055 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884057 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884060 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884063 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884067 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884071 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884074 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884077 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884080 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884084 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884088 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884091 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884094 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884097 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884100 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884103 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884106 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884108 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884112 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 01:20:08.886826 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884115 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884118 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884120 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884122 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884125 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884128 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884131 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884134 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884137 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884139 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884142 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884145 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884147 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884150 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884152 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884155 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884157 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884160 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884162 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884165 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 01:20:08.887295 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884168 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884589 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884594 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884597 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884601 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884604 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884607 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884612 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884615 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884618 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884620 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884624 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884627 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884630 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884633 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884636 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884640 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884642 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884646 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 01:20:08.887774 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884648 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884652 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884654 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884657 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884659 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884663 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884665 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884668 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884671 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884673 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884676 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884678 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884681 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884683 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884686 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884688 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884691 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884694 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884696 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884698 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 01:20:08.888253 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884701 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884703 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884706 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884708 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884712 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884715 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884718 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884721 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884724 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884727 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884730 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884732 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884736 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884739 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884742 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884744 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884747 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884750 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884752 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 01:20:08.888727 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884754 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884757 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884760 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884762 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884765 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884767 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884769 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884772 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884774 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884777 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884780 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884783 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884786 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884788 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884791 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884793 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884796 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884798 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884801 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884803 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 01:20:08.889196 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884806 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884808 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884813 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884815 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884818 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884820 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884823 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884826 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884829 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884831 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884835 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884838 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884840 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884843 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884845 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884848 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884850 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884853 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884855 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 01:20:08.889675 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884858 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884860 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.884863 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884929 2571 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884936 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884956 2571 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884963 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884969 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884974 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884980 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884987 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884990 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884993 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.884997 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885000 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885005 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885008 2571 flags.go:64] FLAG: --cgroup-root="" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885011 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885014 2571 flags.go:64] FLAG: --client-ca-file="" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885017 2571 flags.go:64] FLAG: --cloud-provider="external" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885021 2571 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885026 2571 flags.go:64] FLAG: --cluster-domain="" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885029 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 01:20:08.890155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885032 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885035 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885038 2571 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885042 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885045 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885049 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885052 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885055 2571 flags.go:64] FLAG: --contention-profiling="false" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885058 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885061 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885064 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885067 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885071 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885074 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885077 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885080 2571 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885083 2571 flags.go:64] FLAG: --enable-server="true" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885086 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885090 2571 flags.go:64] FLAG: --event-burst="100" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885094 2571 flags.go:64] FLAG: --event-qps="50" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885097 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885100 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885103 2571 flags.go:64] FLAG: --eviction-hard="" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885107 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 01:20:08.890719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885111 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885114 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885117 2571 flags.go:64] FLAG: --eviction-soft="" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885120 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885123 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885126 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885130 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885133 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885136 2571 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885139 2571 flags.go:64] FLAG: --feature-gates="" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885143 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885146 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885149 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885152 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885155 2571 flags.go:64] FLAG: --healthz-port="10248" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885158 2571 flags.go:64] FLAG: --help="false" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885161 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-134-152.ec2.internal" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885164 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885167 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885170 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885174 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885177 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885180 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 01:20:08.891344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885183 2571 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885186 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885188 2571 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885191 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885195 2571 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885197 2571 flags.go:64] FLAG: --kube-reserved="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885200 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885203 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885206 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885210 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885213 2571 flags.go:64] FLAG: --lock-file="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885216 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885219 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885222 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885227 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885230 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885233 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885236 2571 flags.go:64] FLAG: --logging-format="text" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885239 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885242 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885245 2571 flags.go:64] FLAG: --manifest-url="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885248 2571 flags.go:64] FLAG: --manifest-url-header="" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885252 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885255 2571 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885260 2571 flags.go:64] FLAG: --max-pods="110" Jul 06 01:20:08.891914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885263 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885266 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885269 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885272 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885275 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885278 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885281 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885288 2571 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885291 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885294 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885297 2571 flags.go:64] FLAG: --pod-cidr="" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885300 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885305 2571 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885308 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885312 2571 flags.go:64] FLAG: --pods-per-core="0" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885315 2571 flags.go:64] FLAG: --port="10250" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885318 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885322 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0175cffa24e251fd7" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885325 2571 flags.go:64] FLAG: --qos-reserved="" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885328 2571 flags.go:64] FLAG: --read-only-port="10255" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885331 2571 flags.go:64] FLAG: --register-node="true" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885334 2571 flags.go:64] FLAG: --register-with-taints="" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885337 2571 flags.go:64] FLAG: --registry-burst="10" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885340 2571 flags.go:64] FLAG: --registry-qps="5" Jul 06 01:20:08.892537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885346 2571 flags.go:64] FLAG: --reserved-cpus="" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885349 2571 flags.go:64] FLAG: --reserved-memory="" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885353 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885357 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885360 2571 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885363 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885366 2571 flags.go:64] FLAG: --runonce="false" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885369 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885372 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885375 2571 flags.go:64] FLAG: --seccomp-default="false" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885378 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885381 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885384 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885387 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885390 2571 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885392 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885395 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885398 2571 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885401 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885404 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885407 2571 flags.go:64] FLAG: --system-cgroups="" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885410 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885415 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885418 2571 flags.go:64] FLAG: --tls-cert-file="" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885421 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 01:20:08.893147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885426 2571 flags.go:64] FLAG: --tls-min-version="" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885429 2571 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885432 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885435 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885437 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885440 2571 flags.go:64] FLAG: --v="2" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885444 2571 flags.go:64] FLAG: --version="false" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885449 2571 flags.go:64] FLAG: --vmodule="" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885454 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.885457 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885577 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885582 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885585 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885588 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885591 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885593 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885596 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885598 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885601 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885605 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885608 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 01:20:08.893824 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885611 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885614 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885617 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885620 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885631 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885634 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885637 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885640 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885642 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885645 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885647 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885650 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885653 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885656 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885658 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885661 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885664 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885667 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885671 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885673 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 01:20:08.894670 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885677 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885679 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885682 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885685 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885688 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885692 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885695 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885698 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885701 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885704 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885707 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885710 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885713 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885715 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885718 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885721 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885724 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885726 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885729 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 01:20:08.895618 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885732 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885734 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885737 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885739 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885742 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885745 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885747 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885750 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885752 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885754 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885757 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885761 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885763 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885766 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885769 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885771 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885774 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885776 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885779 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885781 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 01:20:08.896406 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885784 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885787 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885789 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885792 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885794 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885796 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885799 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885801 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885804 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885806 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885809 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885811 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885814 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885816 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885819 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885821 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885824 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885826 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885829 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885831 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 01:20:08.897296 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885834 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885836 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885838 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885842 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885845 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885847 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885850 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885853 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.885855 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.886814 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.896360 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.896383 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.896409 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.896418 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 01:20:08.898091 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896504 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896512 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896517 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896522 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896526 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896530 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896535 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896539 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896543 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896547 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896551 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896556 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896561 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896565 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896570 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896575 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896579 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896583 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896587 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896592 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 01:20:08.898452 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896596 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896600 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896604 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896608 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896613 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896619 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896623 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896627 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896631 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896636 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896640 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896645 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896649 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896654 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896658 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896664 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896671 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896675 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896679 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896684 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 01:20:08.899271 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896688 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896692 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896697 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896701 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896705 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896710 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896716 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896721 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896725 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896729 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896733 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896738 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896742 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896746 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896751 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896755 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896760 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896767 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896773 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896777 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 01:20:08.899799 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896782 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896788 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896792 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896797 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896802 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896807 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896811 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896816 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896821 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896825 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896829 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896833 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896837 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896841 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896846 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896850 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896854 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896858 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896862 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 01:20:08.900306 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896867 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896872 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896876 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896880 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896884 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896888 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896893 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896897 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896901 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896905 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896910 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896914 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896918 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896923 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896927 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896931 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896938 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896964 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896969 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 01:20:08.901057 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.896974 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.896982 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897162 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897171 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897175 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897180 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897184 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897188 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897193 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897197 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897201 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897206 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897210 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897215 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897221 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 01:20:08.901702 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897225 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897229 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897233 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897237 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897241 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897245 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897249 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897253 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897257 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897262 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897266 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897270 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897275 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897279 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897283 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897288 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897292 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897296 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897300 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897304 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 01:20:08.902170 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897308 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897312 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897315 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897319 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897325 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897332 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897337 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897342 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897347 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897352 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897356 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897361 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897366 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897370 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897375 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897379 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897384 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897388 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897392 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 01:20:08.902714 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897397 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897401 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897406 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897412 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897418 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897423 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897427 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897431 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897436 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897440 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897444 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897448 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897455 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897460 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897465 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897470 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897475 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897480 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897484 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 01:20:08.903381 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897488 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897492 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897498 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897502 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897507 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897513 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897517 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897522 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897527 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897531 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897535 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897539 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897544 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897548 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897553 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897557 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897562 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897566 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897570 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897575 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 01:20:08.903901 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897579 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897583 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897587 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897592 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897596 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897601 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897605 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:08.897609 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.897617 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.897802 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.902094 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.903609 2571 server.go:1019] "Starting client certificate rotation" Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.903711 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 01:20:08.904405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.903744 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 01:20:08.906455 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.906438 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 01:20:08.910502 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.910482 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 01:20:08.924979 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.924960 2571 log.go:25] "Validated CRI v1 runtime API" Jul 06 01:20:08.927109 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.927096 2571 log.go:25] "Validated CRI v1 image API" Jul 06 01:20:08.927986 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.927973 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 01:20:08.932750 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.932728 2571 fs.go:135] Filesystem UUIDs: map[6af8a744-fcde-4363-bec2-c11a8c902bc8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a8979b3c-96d5-4a7b-9c38-a559008c8993:/dev/nvme0n1p4] Jul 06 01:20:08.932834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.932755 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 01:20:08.933599 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.933582 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 01:20:08.938701 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.938591 2571 manager.go:216] Machine: {Timestamp:2026-07-06 01:20:08.938078575 +0000 UTC m=+0.360881620 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099064 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f199f7939b10ec0a2cc36e0865d0e SystemUUID:ec2f199f-7939-b10e-c0a2-cc36e0865d0e BootID:61a4f746-c701-44a1-b5f9-8da270bfcc16 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:d3:88:01:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:d3:88:01:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:98:65:16:b1:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 01:20:08.938701 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.938695 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 01:20:08.938796 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.938778 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 01:20:08.939935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.939910 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 01:20:08.940091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.939938 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 01:20:08.940724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.940715 2571 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 01:20:08.940754 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.940727 2571 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 01:20:08.940754 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.940734 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 01:20:08.941438 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.941428 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 01:20:08.943072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.943062 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 01:20:08.947331 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947310 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 06 01:20:08.947462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947453 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 01:20:08.947498 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947483 2571 kubelet.go:486] "Attempting to sync node with API server" Jul 06 01:20:08.947498 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947494 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 01:20:08.947563 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947506 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 01:20:08.947563 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947516 2571 kubelet.go:398] "Adding apiserver pod source" Jul 06 01:20:08.947563 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947525 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 01:20:08.948012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.947998 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 01:20:08.948059 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.948026 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 01:20:08.951110 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.951073 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 01:20:08.953610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.953597 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 01:20:08.953684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.953634 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 01:20:08.954840 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.954825 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvpxj" Jul 06 01:20:08.956116 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956104 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 01:20:08.956163 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956123 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 01:20:08.956163 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956132 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 01:20:08.956163 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956138 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 01:20:08.956163 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956147 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 01:20:08.956163 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956155 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956166 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956172 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956180 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956188 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956200 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956208 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956234 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 01:20:08.956318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.956242 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 01:20:08.956579 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.956347 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 01:20:08.956579 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.956381 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 01:20:08.959434 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.959421 2571 server.go:1268] "Started kubelet" Jul 06 01:20:08.959520 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.959477 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 01:20:08.959520 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.959482 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 01:20:08.959611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.959546 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 01:20:08.960274 ip-10-0-134-152 systemd[1]: Started Kubernetes Kubelet. Jul 06 01:20:08.960426 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.960386 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 01:20:08.963094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.962867 2571 server.go:310] "Adding debug handlers to kubelet server" Jul 06 01:20:08.963094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.963083 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvpxj" Jul 06 01:20:08.966679 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.965539 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18bf8ea32db0ff72 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-07-06 01:20:08.95939365 +0000 UTC m=+0.382196697,LastTimestamp:2026-07-06 01:20:08.95939365 +0000 UTC m=+0.382196697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}" Jul 06 01:20:08.967401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.967380 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 01:20:08.968009 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.967991 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 01:20:08.974767 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.974751 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 01:20:08.975489 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.975473 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 01:20:08.975676 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.975642 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:08.976297 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976280 2571 factory.go:55] Registering systemd factory Jul 06 01:20:08.976375 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976299 2571 factory.go:223] Registration of the systemd container factory successfully Jul 06 01:20:08.976447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976417 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 01:20:08.976447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976428 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 01:20:08.976447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976441 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 01:20:08.976551 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976531 2571 factory.go:153] Registering CRI-O factory Jul 06 01:20:08.976551 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976550 2571 factory.go:223] Registration of the crio container factory successfully Jul 06 01:20:08.976647 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976603 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 01:20:08.976647 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976627 2571 factory.go:103] Registering Raw factory Jul 06 01:20:08.976647 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976643 2571 manager.go:1196] Started watching for new ooms in manager Jul 06 01:20:08.976774 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976660 2571 reconstruct.go:97] "Volume reconstruction finished" Jul 06 01:20:08.976774 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.976668 2571 reconciler.go:29] "Reconciler: start to sync state" Jul 06 01:20:08.977400 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.977382 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 01:20:08.977686 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:08.977661 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 01:20:08.977848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.977835 2571 manager.go:349] Starting recovery of all containers Jul 06 01:20:08.993266 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.993244 2571 manager.go:354] Recovery completed Jul 06 01:20:08.997443 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.997426 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:08.999978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.999960 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.000055 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:08.999991 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.000055 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.000002 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.000577 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.000563 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 01:20:09.000577 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.000575 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 01:20:09.000666 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.000592 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 06 01:20:09.000666 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.000575 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:09.001436 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.001421 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.001491 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.001451 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.001491 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.001465 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.076590 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.076536 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.146449 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.146391 2571 policy_none.go:49] "None policy: Start" Jul 06 01:20:09.146449 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.146443 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 01:20:09.146570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.146457 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 01:20:09.148627 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.148613 2571 policy_none.go:47] "Start" Jul 06 01:20:09.176643 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.176621 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.181741 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.181727 2571 manager.go:337] "Starting Device Plugin manager" Jul 06 01:20:09.181834 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.181820 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 01:20:09.181873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.181837 2571 server.go:87] "Starting device plugin registration server" Jul 06 01:20:09.182130 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.182118 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 01:20:09.182204 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.182132 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 01:20:09.182245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.182232 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 01:20:09.182330 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.182303 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 01:20:09.182330 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.182317 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 01:20:09.182850 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.182831 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 01:20:09.182964 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.182883 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.183426 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.183410 2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.263219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.263052 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 01:20:09.264418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.264382 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 01:20:09.264537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.264437 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 01:20:09.264537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.264468 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 01:20:09.264537 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.264510 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 01:20:09.267061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.267037 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 01:20:09.282520 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.282501 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:09.283366 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.283351 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.283463 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.283384 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.283463 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.283400 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.283463 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.283431 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.289911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.289897 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.289986 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.289918 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-152.ec2.internal\": node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.303959 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.303924 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.365303 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.365256 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"] Jul 06 01:20:09.365428 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.365355 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:09.367673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.367649 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.367772 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.367684 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.367772 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.367700 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.370060 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.370048 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:09.370174 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.370161 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.370206 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.370194 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:09.371118 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.371098 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.371197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.371133 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.371197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.371102 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.371197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.371161 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.371197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.371189 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.371355 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.371203 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.373453 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.373438 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.373520 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.373467 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 01:20:09.375229 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.375212 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory" Jul 06 01:20:09.375302 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.375242 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 01:20:09.375302 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.375253 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID" Jul 06 01:20:09.379416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.379401 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d52ec35a2797f833affacfeeaaf504f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"d52ec35a2797f833affacfeeaaf504f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.379474 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.379426 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6510e963d2c0197b770e28d3db5696cd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"6510e963d2c0197b770e28d3db5696cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.379474 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.379443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d52ec35a2797f833affacfeeaaf504f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"d52ec35a2797f833affacfeeaaf504f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.393570 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.393551 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.397824 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.397789 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.404984 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.404971 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.480598 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.480570 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6510e963d2c0197b770e28d3db5696cd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"6510e963d2c0197b770e28d3db5696cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.480711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.480602 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d52ec35a2797f833affacfeeaaf504f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"d52ec35a2797f833affacfeeaaf504f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.480711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.480621 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d52ec35a2797f833affacfeeaaf504f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"d52ec35a2797f833affacfeeaaf504f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.480711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.480660 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d52ec35a2797f833affacfeeaaf504f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"d52ec35a2797f833affacfeeaaf504f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.480711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.480678 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d52ec35a2797f833affacfeeaaf504f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"d52ec35a2797f833affacfeeaaf504f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.480711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.480660 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6510e963d2c0197b770e28d3db5696cd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"6510e963d2c0197b770e28d3db5696cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.505701 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.505668 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.606231 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.606189 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.695787 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.695727 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.701460 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.701096 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.707214 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.707195 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.808390 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.808345 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.826532 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.826505 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 01:20:09.904010 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.903980 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 01:20:09.904495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.904135 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 01:20:09.904495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.904168 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 01:20:09.908549 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:09.908528 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found" Jul 06 01:20:09.953730 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.953662 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 01:20:09.973134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.973105 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 01:15:09 +0000 UTC" deadline="2028-04-06 15:11:44.381319418 +0000 UTC" Jul 06 01:20:09.973134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.973130 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15373h51m34.408192864s" Jul 06 01:20:09.975685 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.975672 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.975732 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.975697 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 01:20:09.983880 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.983861 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 01:20:09.984892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.984879 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" Jul 06 01:20:09.987548 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.987529 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 01:20:09.994593 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:09.994574 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 01:20:10.005136 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.005117 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jzhzm" Jul 06 01:20:10.013217 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.013194 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jzhzm" Jul 06 01:20:10.164628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.164602 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 01:20:10.315137 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:10.315101 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52ec35a2797f833affacfeeaaf504f9.slice/crio-9ac4d27e15f17edd86ee4a3511027d35140c97f0f23e19c3c4beff54b65ae279 WatchSource:0}: Error finding container 9ac4d27e15f17edd86ee4a3511027d35140c97f0f23e19c3c4beff54b65ae279: Status 404 returned error can't find the container with id 9ac4d27e15f17edd86ee4a3511027d35140c97f0f23e19c3c4beff54b65ae279 Jul 06 01:20:10.321746 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.321723 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:20:10.325172 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:10.325149 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6510e963d2c0197b770e28d3db5696cd.slice/crio-184ba86d67e7a85bc6514a148f55e7f67b29d0ac08189be5d94f3643127791a7 WatchSource:0}: Error finding container 184ba86d67e7a85bc6514a148f55e7f67b29d0ac08189be5d94f3643127791a7: Status 404 returned error can't find the container with id 184ba86d67e7a85bc6514a148f55e7f67b29d0ac08189be5d94f3643127791a7 Jul 06 01:20:10.948097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.948058 2571 apiserver.go:52] "Watching apiserver" Jul 06 01:20:10.959247 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.959217 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 01:20:10.959672 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.959643 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal","openshift-multus/multus-additional-cni-plugins-6jgv2","openshift-network-diagnostics/network-check-target-f7fpk","openshift-network-operator/iptables-alerter-29bc7","openshift-ovn-kubernetes/ovnkube-node-xlzn7","kube-system/konnectivity-agent-hq2kt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx","openshift-cluster-node-tuning-operator/tuned-dtst8","openshift-dns/node-resolver-qjs8x","openshift-multus/multus-qqxp2","openshift-multus/network-metrics-daemon-jv4mv","kube-system/global-pull-secret-syncer-pp2g5","kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal","openshift-image-registry/node-ca-ncsk8"] Jul 06 01:20:10.962457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.962430 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.965184 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.964841 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:10.965184 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:10.964918 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:10.965184 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.965165 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.965398 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.965194 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 01:20:10.965398 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.965321 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2nxdl\"" Jul 06 01:20:10.965514 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.965455 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.967335 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.967315 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:10.967430 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:10.967385 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:10.969670 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.969648 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:10.972604 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.972567 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.972713 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.972697 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9mpdd\"" Jul 06 01:20:10.972713 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.972560 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 01:20:10.972942 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.972921 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.973988 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.973968 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.976284 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.976264 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 01:20:10.976427 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.976368 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dkpt6\"" Jul 06 01:20:10.976807 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.976762 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:10.977371 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.977347 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 01:20:10.977371 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.977362 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.977510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.977472 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 01:20:10.977570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.977543 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 01:20:10.977630 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.977608 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.979004 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.978985 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wn6hq\"" Jul 06 01:20:10.979442 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.979046 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 01:20:10.979442 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.979147 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 01:20:10.979574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.979458 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:10.982483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.981914 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:10.982483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.981982 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.982483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.982003 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lgmlw\"" Jul 06 01:20:10.982483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.982113 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.984434 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.984414 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.984536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.984438 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9c475\"" Jul 06 01:20:10.984536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.984506 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 01:20:10.984639 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.984443 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.985368 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.984787 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:10.987050 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987012 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.987403 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987385 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4kzbm\"" Jul 06 01:20:10.987790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987614 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 01:20:10.987790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987698 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 01:20:10.987790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987700 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 01:20:10.987790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987722 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.988066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.987799 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqxp2" Jul 06 01:20:10.989771 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.989751 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:10.990280 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.990213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.991189 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5k8k\" (UniqueName: \"kubernetes.io/projected/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-kube-api-access-n5k8k\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.991255 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-kubelet\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.991286 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-ovn\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.991322 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-log-socket\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.991600 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992154 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n9zdk\"" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992233 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992550 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-run-ovn-kubernetes\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992597 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-ovnkube-script-lib\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992632 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d95d447d-2ac0-4646-b14e-6b4d6fc43d5c-konnectivity-ca\") pod \"konnectivity-agent-hq2kt\" (UID: \"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c\") " pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992650 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992661 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992702 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-systemd\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-cni-netd\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992768 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-socket-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992798 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-systemd-units\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992828 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-run-netns\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993046 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:10.992803 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992865 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-node-log\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992895 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.992895 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e5dc17-dc36-46ba-b633-32def067e505-ovn-node-metrics-cert\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-registration-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993341 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08838b2d-632c-448f-97d5-29f33c641071-iptables-alerter-script\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993405 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-slash\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993437 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-ovnkube-config\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993467 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993546 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdjq\" (UniqueName: \"kubernetes.io/projected/08838b2d-632c-448f-97d5-29f33c641071-kube-api-access-wvdjq\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993578 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-device-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993612 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-sys-fs\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993645 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnlq4\" (UniqueName: \"kubernetes.io/projected/9ba2693c-c2fb-4810-b63b-639d251c80a0-kube-api-access-hnlq4\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993677 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08838b2d-632c-448f-97d5-29f33c641071-host-slash\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993707 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-var-lib-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.993959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993742 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-etc-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993774 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993781 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vj8qt\"" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993804 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-env-overrides\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993836 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-cni-bin\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993865 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993903 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7f69\" (UniqueName: \"kubernetes.io/projected/44e5dc17-dc36-46ba-b633-32def067e505-kube-api-access-t7f69\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:10.994720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:10.993936 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d95d447d-2ac0-4646-b14e-6b4d6fc43d5c-agent-certs\") pod \"konnectivity-agent-hq2kt\" (UID: \"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c\") " pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:11.017137 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.017081 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 01:15:10 +0000 UTC" deadline="2028-02-24 10:50:08.125149237 +0000 UTC" Jul 06 01:20:11.017137 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.017137 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14361h29m57.108016486s" Jul 06 01:20:11.078251 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.078221 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-host\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d24bbed-1fab-473d-928a-e76a74b4780c-hosts-file\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094276 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81916daf-c70e-4cf0-afbc-6f9e5806ba00-kubelet-config\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094302 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094328 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-cni-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094374 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094401 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08838b2d-632c-448f-97d5-29f33c641071-iptables-alerter-script\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094425 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-slash\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094450 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-system-cni-dir\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094477 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbnmq\" (UniqueName: \"kubernetes.io/projected/30197e12-318a-4318-98f4-f6e76de8f3db-kube-api-access-sbnmq\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.094513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-k8s-cni-cncf-io\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094529 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-hostroot\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094552 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-system-cni-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094597 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-var-lib-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094623 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-etc-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094657 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-cnibin\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094694 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-os-release\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094720 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svbnb\" (UniqueName: \"kubernetes.io/projected/d0d5df89-8d1a-4758-830b-3d8da03c8283-kube-api-access-svbnb\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094738 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-cni-bin\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094766 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7f69\" (UniqueName: \"kubernetes.io/projected/44e5dc17-dc36-46ba-b633-32def067e505-kube-api-access-t7f69\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094790 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6326da57-2656-4351-b417-b45cf45a621c-multus-daemon-config\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094808 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cecfe8c-a378-41ca-9656-bceebfd3f60a-host\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094830 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5k8k\" (UniqueName: \"kubernetes.io/projected/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-kube-api-access-n5k8k\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094848 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-run-ovn-kubernetes\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094866 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d95d447d-2ac0-4646-b14e-6b4d6fc43d5c-konnectivity-ca\") pod \"konnectivity-agent-hq2kt\" (UID: \"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c\") " pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094915 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-cnibin\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.095222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094939 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d24bbed-1fab-473d-928a-e76a74b4780c-tmp-dir\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094965 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-systemd\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.094991 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-cni-netd\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095053 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095077 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-tuned\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095103 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0d5df89-8d1a-4758-830b-3d8da03c8283-tmp\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095132 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-systemd-units\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095157 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-netns\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095182 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-cni-bin\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095208 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-cni-multus\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-systemd\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095250 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-sys\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095239 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08838b2d-632c-448f-97d5-29f33c641071-iptables-alerter-script\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095274 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-run-netns\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095333 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-run-netns\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095361 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-node-log\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095384 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-slash\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095397 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e5dc17-dc36-46ba-b633-32def067e505-ovn-node-metrics-cert\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095454 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-var-lib-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095458 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-etc-kubernetes\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095495 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-etc-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095504 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-lib-modules\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095534 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-registration-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-cni-bin\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-ovnkube-config\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095604 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81916daf-c70e-4cf0-afbc-6f9e5806ba00-dbus\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095626 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-socket-dir-parent\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095644 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-kubelet\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095660 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/6326da57-2656-4351-b417-b45cf45a621c-kube-api-access-t6t99\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095703 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-run\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095727 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cecfe8c-a378-41ca-9656-bceebfd3f60a-serviceca\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095755 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095783 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdjq\" (UniqueName: \"kubernetes.io/projected/08838b2d-632c-448f-97d5-29f33c641071-kube-api-access-wvdjq\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095809 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.096976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095835 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwxvd\" (UniqueName: \"kubernetes.io/projected/7cecfe8c-a378-41ca-9656-bceebfd3f60a-kube-api-access-pwxvd\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095856 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-device-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095874 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-sys-fs\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095893 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnlq4\" (UniqueName: \"kubernetes.io/projected/9ba2693c-c2fb-4810-b63b-639d251c80a0-kube-api-access-hnlq4\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095912 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08838b2d-632c-448f-97d5-29f33c641071-host-slash\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095929 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095947 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-env-overrides\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095970 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d95d447d-2ac0-4646-b14e-6b4d6fc43d5c-agent-certs\") pod \"konnectivity-agent-hq2kt\" (UID: \"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c\") " pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.095991 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-kubernetes\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096037 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096055 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096076 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-conf-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096092 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysconfig\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096110 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096126 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-kubelet\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-ovn\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096160 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-log-socket\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.097849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096158 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-ovnkube-config\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096177 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-ovnkube-script-lib\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096197 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6326da57-2656-4351-b417-b45cf45a621c-cni-binary-copy\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096220 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-multus-certs\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096237 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nxq4\" (UniqueName: \"kubernetes.io/projected/6d24bbed-1fab-473d-928a-e76a74b4780c-kube-api-access-9nxq4\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.096279 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-os-release\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096332 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysctl-d\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.096371 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:11.596336314 +0000 UTC m=+3.019139367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096415 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-node-log\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096766 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.096868 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-run-ovn-kubernetes\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097435 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d95d447d-2ac0-4646-b14e-6b4d6fc43d5c-konnectivity-ca\") pod \"konnectivity-agent-hq2kt\" (UID: \"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c\") " pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097503 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-device-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097565 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-kubelet\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097570 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.098721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-sys-fs\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097627 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097634 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-systemd\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097665 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097702 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-host-cni-netd\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097708 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-ovn\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097744 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-socket-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097763 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-log-socket\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097774 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-modprobe-d\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.097802 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysctl-conf\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-run-openvswitch\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098149 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-var-lib-kubelet\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098183 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e5dc17-dc36-46ba-b633-32def067e505-systemd-units\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098248 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08838b2d-632c-448f-97d5-29f33c641071-host-slash\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098250 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-registration-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098273 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ba2693c-c2fb-4810-b63b-639d251c80a0-socket-dir\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098316 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-ovnkube-script-lib\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.099573 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.098764 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e5dc17-dc36-46ba-b633-32def067e505-env-overrides\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.103413 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.103389 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e5dc17-dc36-46ba-b633-32def067e505-ovn-node-metrics-cert\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.104635 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.104614 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:11.104744 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.104641 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:11.104744 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.104655 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:11.104744 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.104724 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:20:11.604704129 +0000 UTC m=+3.027507179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:11.106226 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.106200 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d95d447d-2ac0-4646-b14e-6b4d6fc43d5c-agent-certs\") pod \"konnectivity-agent-hq2kt\" (UID: \"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c\") " pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:11.108500 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.108439 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5k8k\" (UniqueName: \"kubernetes.io/projected/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-kube-api-access-n5k8k\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:11.108972 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.108930 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdjq\" (UniqueName: \"kubernetes.io/projected/08838b2d-632c-448f-97d5-29f33c641071-kube-api-access-wvdjq\") pod \"iptables-alerter-29bc7\" (UID: \"08838b2d-632c-448f-97d5-29f33c641071\") " pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.110519 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.110499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7f69\" (UniqueName: \"kubernetes.io/projected/44e5dc17-dc36-46ba-b633-32def067e505-kube-api-access-t7f69\") pod \"ovnkube-node-xlzn7\" (UID: \"44e5dc17-dc36-46ba-b633-32def067e505\") " pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.110800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.110776 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnlq4\" (UniqueName: \"kubernetes.io/projected/9ba2693c-c2fb-4810-b63b-639d251c80a0-kube-api-access-hnlq4\") pod \"aws-ebs-csi-driver-node-wfgmx\" (UID: \"9ba2693c-c2fb-4810-b63b-639d251c80a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.199371 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199290 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.199371 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199335 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-cnibin\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199371 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199357 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d24bbed-1fab-473d-928a-e76a74b4780c-tmp-dir\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199383 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-tuned\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199430 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0d5df89-8d1a-4758-830b-3d8da03c8283-tmp\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199442 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-cnibin\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199454 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-netns\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199492 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-netns\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199492 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-cni-bin\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199526 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-cni-bin\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199530 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-cni-multus\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-systemd\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199566 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199579 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-sys\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199616 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-sys\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199637 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-etc-kubernetes\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.199678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199665 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-lib-modules\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199699 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81916daf-c70e-4cf0-afbc-6f9e5806ba00-dbus\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-socket-dir-parent\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199752 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-kubelet\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/6326da57-2656-4351-b417-b45cf45a621c-kube-api-access-t6t99\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199802 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-run\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199826 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cecfe8c-a378-41ca-9656-bceebfd3f60a-serviceca\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199854 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwxvd\" (UniqueName: \"kubernetes.io/projected/7cecfe8c-a378-41ca-9656-bceebfd3f60a-kube-api-access-pwxvd\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199911 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-kubernetes\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199937 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-etc-kubernetes\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.199939 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200123 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-run\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200141 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81916daf-c70e-4cf0-afbc-6f9e5806ba00-dbus\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200171 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200205 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-socket-dir-parent\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.200226 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:11.200404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200235 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-kubelet\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.200283 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:11.700264849 +0000 UTC m=+3.123067883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200279 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d24bbed-1fab-473d-928a-e76a74b4780c-tmp-dir\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200358 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-lib-modules\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200376 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-kubernetes\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-conf-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200501 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysconfig\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200533 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6326da57-2656-4351-b417-b45cf45a621c-cni-binary-copy\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200559 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-multus-certs\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nxq4\" (UniqueName: \"kubernetes.io/projected/6d24bbed-1fab-473d-928a-e76a74b4780c-kube-api-access-9nxq4\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200636 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-os-release\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200669 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysctl-d\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200696 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-modprobe-d\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200720 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysctl-conf\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200753 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-var-lib-kubelet\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200780 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-host\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200784 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-multus-certs\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.201308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200805 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d24bbed-1fab-473d-928a-e76a74b4780c-hosts-file\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200824 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cecfe8c-a378-41ca-9656-bceebfd3f60a-serviceca\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200826 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200836 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-conf-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200841 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81916daf-c70e-4cf0-afbc-6f9e5806ba00-kubelet-config\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200868 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200881 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysconfig\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200895 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-cni-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200922 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-var-lib-cni-multus\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200935 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-system-cni-dir\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200941 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-os-release\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200963 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnmq\" (UniqueName: \"kubernetes.io/projected/30197e12-318a-4318-98f4-f6e76de8f3db-kube-api-access-sbnmq\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.200993 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-k8s-cni-cncf-io\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201038 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-hostroot\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201057 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysctl-d\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201064 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-system-cni-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201095 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-cnibin\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.202173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201120 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-os-release\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201132 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-modprobe-d\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201150 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svbnb\" (UniqueName: \"kubernetes.io/projected/d0d5df89-8d1a-4758-830b-3d8da03c8283-kube-api-access-svbnb\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201180 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6326da57-2656-4351-b417-b45cf45a621c-multus-daemon-config\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201217 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cecfe8c-a378-41ca-9656-bceebfd3f60a-host\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201226 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-var-lib-kubelet\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201353 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6326da57-2656-4351-b417-b45cf45a621c-cni-binary-copy\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201428 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-host-run-k8s-cni-cncf-io\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201479 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-hostroot\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201486 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-sysctl-conf\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201179 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-system-cni-dir\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201535 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cecfe8c-a378-41ca-9656-bceebfd3f60a-host\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201542 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-cnibin\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201581 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-system-cni-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201598 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30197e12-318a-4318-98f4-f6e76de8f3db-os-release\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201666 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-host\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201708 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d24bbed-1fab-473d-928a-e76a74b4780c-hosts-file\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201751 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81916daf-c70e-4cf0-afbc-6f9e5806ba00-kubelet-config\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.203416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201801 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6326da57-2656-4351-b417-b45cf45a621c-multus-cni-dir\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.204574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.201944 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30197e12-318a-4318-98f4-f6e76de8f3db-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.204574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.202007 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-systemd\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.204574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.202269 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0d5df89-8d1a-4758-830b-3d8da03c8283-etc-tuned\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.204574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.202480 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6326da57-2656-4351-b417-b45cf45a621c-multus-daemon-config\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.204574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.204208 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0d5df89-8d1a-4758-830b-3d8da03c8283-tmp\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.213937 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.213908 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwxvd\" (UniqueName: \"kubernetes.io/projected/7cecfe8c-a378-41ca-9656-bceebfd3f60a-kube-api-access-pwxvd\") pod \"node-ca-ncsk8\" (UID: \"7cecfe8c-a378-41ca-9656-bceebfd3f60a\") " pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.214699 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.214672 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svbnb\" (UniqueName: \"kubernetes.io/projected/d0d5df89-8d1a-4758-830b-3d8da03c8283-kube-api-access-svbnb\") pod \"tuned-dtst8\" (UID: \"d0d5df89-8d1a-4758-830b-3d8da03c8283\") " pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.214823 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.214672 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnmq\" (UniqueName: \"kubernetes.io/projected/30197e12-318a-4318-98f4-f6e76de8f3db-kube-api-access-sbnmq\") pod \"multus-additional-cni-plugins-6jgv2\" (UID: \"30197e12-318a-4318-98f4-f6e76de8f3db\") " pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.215174 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.215147 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/6326da57-2656-4351-b417-b45cf45a621c-kube-api-access-t6t99\") pod \"multus-qqxp2\" (UID: \"6326da57-2656-4351-b417-b45cf45a621c\") " pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.217306 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.217258 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nxq4\" (UniqueName: \"kubernetes.io/projected/6d24bbed-1fab-473d-928a-e76a74b4780c-kube-api-access-9nxq4\") pod \"node-resolver-qjs8x\" (UID: \"6d24bbed-1fab-473d-928a-e76a74b4780c\") " pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.269790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.269724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" event={"ID":"6510e963d2c0197b770e28d3db5696cd","Type":"ContainerStarted","Data":"184ba86d67e7a85bc6514a148f55e7f67b29d0ac08189be5d94f3643127791a7"} Jul 06 01:20:11.271994 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.271947 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"d52ec35a2797f833affacfeeaaf504f9","Type":"ContainerStarted","Data":"9ac4d27e15f17edd86ee4a3511027d35140c97f0f23e19c3c4beff54b65ae279"} Jul 06 01:20:11.276450 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.276388 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" Jul 06 01:20:11.286265 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.286241 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29bc7" Jul 06 01:20:11.286454 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.286415 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba2693c_c2fb_4810_b63b_639d251c80a0.slice/crio-120146dee8fcceee8909538242b0a20dd559821faf4948df2acbe59033067644 WatchSource:0}: Error finding container 120146dee8fcceee8909538242b0a20dd559821faf4948df2acbe59033067644: Status 404 returned error can't find the container with id 120146dee8fcceee8909538242b0a20dd559821faf4948df2acbe59033067644 Jul 06 01:20:11.296978 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.296939 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08838b2d_632c_448f_97d5_29f33c641071.slice/crio-c3bcc595c56f0bba5ce0639fbaf79f5d41a83c6d06260ab378e71ce815585d67 WatchSource:0}: Error finding container c3bcc595c56f0bba5ce0639fbaf79f5d41a83c6d06260ab378e71ce815585d67: Status 404 returned error can't find the container with id c3bcc595c56f0bba5ce0639fbaf79f5d41a83c6d06260ab378e71ce815585d67 Jul 06 01:20:11.299631 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.299606 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:11.309639 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.309613 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:11.311048 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.311019 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e5dc17_dc36_46ba_b633_32def067e505.slice/crio-9044ec0fac79ab8629ea891009b60fb8ecc75fbca93c19bc0ab96583691999c2 WatchSource:0}: Error finding container 9044ec0fac79ab8629ea891009b60fb8ecc75fbca93c19bc0ab96583691999c2: Status 404 returned error can't find the container with id 9044ec0fac79ab8629ea891009b60fb8ecc75fbca93c19bc0ab96583691999c2 Jul 06 01:20:11.316696 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.316662 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qjs8x" Jul 06 01:20:11.320596 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.320567 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95d447d_2ac0_4646_b14e_6b4d6fc43d5c.slice/crio-552be8762f3a39e430f4d0bbe725d64d0c5e50402d202bc57fef022c27072c49 WatchSource:0}: Error finding container 552be8762f3a39e430f4d0bbe725d64d0c5e50402d202bc57fef022c27072c49: Status 404 returned error can't find the container with id 552be8762f3a39e430f4d0bbe725d64d0c5e50402d202bc57fef022c27072c49 Jul 06 01:20:11.326901 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.326735 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ncsk8" Jul 06 01:20:11.328694 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.328667 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d24bbed_1fab_473d_928a_e76a74b4780c.slice/crio-892ea689db73ee3a9f93df7a1abd5c72c7fd004598759d31cf96fd58e64508f7 WatchSource:0}: Error finding container 892ea689db73ee3a9f93df7a1abd5c72c7fd004598759d31cf96fd58e64508f7: Status 404 returned error can't find the container with id 892ea689db73ee3a9f93df7a1abd5c72c7fd004598759d31cf96fd58e64508f7 Jul 06 01:20:11.335439 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.335267 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" Jul 06 01:20:11.338594 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.338487 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cecfe8c_a378_41ca_9656_bceebfd3f60a.slice/crio-d73cc1dc43e7392531d9d66a844cbd10d6ccc346e0379f1f47a306224d5aeb31 WatchSource:0}: Error finding container d73cc1dc43e7392531d9d66a844cbd10d6ccc346e0379f1f47a306224d5aeb31: Status 404 returned error can't find the container with id d73cc1dc43e7392531d9d66a844cbd10d6ccc346e0379f1f47a306224d5aeb31 Jul 06 01:20:11.342263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.342180 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqxp2" Jul 06 01:20:11.346867 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.346814 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30197e12_318a_4318_98f4_f6e76de8f3db.slice/crio-66757d1264b922077472351bd9a164f2e07057d45728418ddf75784a3ea5c861 WatchSource:0}: Error finding container 66757d1264b922077472351bd9a164f2e07057d45728418ddf75784a3ea5c861: Status 404 returned error can't find the container with id 66757d1264b922077472351bd9a164f2e07057d45728418ddf75784a3ea5c861 Jul 06 01:20:11.350803 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.350778 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtst8" Jul 06 01:20:11.358834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.358533 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 01:20:11.363281 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:11.363254 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d5df89_8d1a_4758_830b_3d8da03c8283.slice/crio-63e79c77566771b8e97bdca5f7ac908f5e4e9a98b2949ed7898ffdb1194fd864 WatchSource:0}: Error finding container 63e79c77566771b8e97bdca5f7ac908f5e4e9a98b2949ed7898ffdb1194fd864: Status 404 returned error can't find the container with id 63e79c77566771b8e97bdca5f7ac908f5e4e9a98b2949ed7898ffdb1194fd864 Jul 06 01:20:11.605566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.605480 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:11.605566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.605537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:11.605805 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.605654 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:11.605805 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.605689 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:11.605805 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.605720 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:11.605805 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.605725 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:12.605705483 +0000 UTC m=+4.028508518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:11.605805 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.605734 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:11.605805 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.605791 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:20:12.605773518 +0000 UTC m=+4.028576579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:11.706640 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:11.706600 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:11.706830 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.706769 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:11.706888 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:11.706833 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:12.706815139 +0000 UTC m=+4.129618403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:12.018354 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.018274 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 01:15:10 +0000 UTC" deadline="2028-03-12 12:35:54.576838688 +0000 UTC" Jul 06 01:20:12.018354 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.018345 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14771h15m42.558499058s" Jul 06 01:20:12.278162 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.278060 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtst8" event={"ID":"d0d5df89-8d1a-4758-830b-3d8da03c8283","Type":"ContainerStarted","Data":"63e79c77566771b8e97bdca5f7ac908f5e4e9a98b2949ed7898ffdb1194fd864"} Jul 06 01:20:12.281134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.281097 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqxp2" event={"ID":"6326da57-2656-4351-b417-b45cf45a621c","Type":"ContainerStarted","Data":"3bfb39df61170a829e994c0d19d5ef77a6d0fcbdbb2e0e59006cb8fd4e57baf3"} Jul 06 01:20:12.283405 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.283373 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerStarted","Data":"66757d1264b922077472351bd9a164f2e07057d45728418ddf75784a3ea5c861"} Jul 06 01:20:12.285592 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.285562 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ncsk8" event={"ID":"7cecfe8c-a378-41ca-9656-bceebfd3f60a","Type":"ContainerStarted","Data":"d73cc1dc43e7392531d9d66a844cbd10d6ccc346e0379f1f47a306224d5aeb31"} Jul 06 01:20:12.287846 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.287817 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29bc7" event={"ID":"08838b2d-632c-448f-97d5-29f33c641071","Type":"ContainerStarted","Data":"c3bcc595c56f0bba5ce0639fbaf79f5d41a83c6d06260ab378e71ce815585d67"} Jul 06 01:20:12.289907 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.289881 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qjs8x" event={"ID":"6d24bbed-1fab-473d-928a-e76a74b4780c","Type":"ContainerStarted","Data":"892ea689db73ee3a9f93df7a1abd5c72c7fd004598759d31cf96fd58e64508f7"} Jul 06 01:20:12.291758 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.291735 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hq2kt" event={"ID":"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c","Type":"ContainerStarted","Data":"552be8762f3a39e430f4d0bbe725d64d0c5e50402d202bc57fef022c27072c49"} Jul 06 01:20:12.294158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.294131 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"9044ec0fac79ab8629ea891009b60fb8ecc75fbca93c19bc0ab96583691999c2"} Jul 06 01:20:12.296527 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.296501 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" event={"ID":"9ba2693c-c2fb-4810-b63b-639d251c80a0","Type":"ContainerStarted","Data":"120146dee8fcceee8909538242b0a20dd559821faf4948df2acbe59033067644"} Jul 06 01:20:12.350716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.350676 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 01:20:12.614866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.614777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:12.614866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.614841 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:12.615168 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.615041 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:12.615168 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.615145 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:14.615125609 +0000 UTC m=+6.037928647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:12.615168 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.615037 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:12.615345 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.615176 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:12.615345 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.615193 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:12.615345 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.615235 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:20:14.615222715 +0000 UTC m=+6.038025754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:12.715891 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:12.715846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:12.716087 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.716037 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:12.716153 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:12.716106 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:14.716086659 +0000 UTC m=+6.138889694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:13.274356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:13.266345 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:13.274990 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:13.274534 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:13.276098 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:13.275137 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:13.276098 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:13.275348 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:13.281929 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:13.281562 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:13.281929 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:13.281710 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:13.311151 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:13.311110 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" event={"ID":"6510e963d2c0197b770e28d3db5696cd","Type":"ContainerStarted","Data":"91afc1d4ede6311960a4f020da6843dda3962797d9b0272b7e7debf828db1a61"} Jul 06 01:20:14.332915 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:14.332096 2571 generic.go:356] "Generic (PLEG): container finished" podID="d52ec35a2797f833affacfeeaaf504f9" containerID="a41fdd74be4386e0b53e6b19fa1501917b4a00abbc268ba93cb6d0e10cda233d" exitCode=0 Jul 06 01:20:14.332915 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:14.332212 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"d52ec35a2797f833affacfeeaaf504f9","Type":"ContainerDied","Data":"a41fdd74be4386e0b53e6b19fa1501917b4a00abbc268ba93cb6d0e10cda233d"} Jul 06 01:20:14.348687 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:14.347347 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" podStartSLOduration=4.34732465 podStartE2EDuration="4.34732465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:13.326142438 +0000 UTC m=+4.748945498" watchObservedRunningTime="2026-07-06 01:20:14.34732465 +0000 UTC m=+5.770127709" Jul 06 01:20:14.633275 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:14.633116 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:14.633275 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:14.633186 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:14.633530 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.633377 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:14.633530 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.633444 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:18.633424121 +0000 UTC m=+10.056227170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:14.634254 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.633922 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:14.634254 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.633958 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:14.634254 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.634064 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:14.634254 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.634130 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:20:18.634111049 +0000 UTC m=+10.056914101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:14.734285 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:14.734242 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:14.734468 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.734435 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:14.734551 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:14.734505 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:18.734485138 +0000 UTC m=+10.157288189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:15.269155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:15.267911 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:15.269155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:15.268104 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:15.269155 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:15.268208 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:15.269155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:15.268656 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:15.269155 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:15.268766 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:15.269689 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:15.269634 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:17.265751 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:17.265698 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:17.266255 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:17.265834 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:17.266255 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:17.265710 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:17.266255 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:17.265961 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:17.266255 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:17.265710 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:17.266255 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:17.266049 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:18.672186 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:18.672144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:18.672208 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.672328 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.672389 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:26.672369334 +0000 UTC m=+18.095172387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.672473 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.672487 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.672498 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:18.672660 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.672534 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:20:26.672523514 +0000 UTC m=+18.095326547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:18.773400 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:18.773364 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:18.773569 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.773516 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:18.773627 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:18.773583 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:26.773563787 +0000 UTC m=+18.196366841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:19.266887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:19.266250 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:19.266887 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:19.266372 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:19.266887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:19.266750 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:19.266887 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:19.266834 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:19.267436 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:19.267313 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:19.267436 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:19.267403 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:21.265611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:21.265574 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:21.266105 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:21.265741 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:21.266105 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:21.266030 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:21.266234 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:21.266141 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:21.266290 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:21.266263 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:21.266393 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:21.266370 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:23.265118 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:23.265076 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:23.265581 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:23.265077 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:23.265581 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:23.265211 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:23.265581 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:23.265315 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:23.265581 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:23.265077 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:23.265581 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:23.265415 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:25.265756 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:25.265719 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:25.266197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:25.265731 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:25.266197 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:25.265860 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:25.266197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:25.265732 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:25.266197 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:25.265976 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:25.266197 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:25.266052 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:26.734970 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:26.734929 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:26.734991 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.735085 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.735103 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.735127 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.735136 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:42.735122167 +0000 UTC m=+34.157925200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.735140 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:26.735425 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.735185 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:20:42.735168978 +0000 UTC m=+34.157972028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:26.835911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:26.835869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:26.836122 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.836031 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:26.836122 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:26.836110 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:20:42.836086758 +0000 UTC m=+34.258889794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:27.264882 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:27.264846 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:27.265064 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:27.264846 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:27.265064 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:27.264846 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:27.265300 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:27.265002 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:27.265443 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:27.265405 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:27.265530 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:27.265506 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:29.266500 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:29.266467 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:29.267045 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:29.266548 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:29.267045 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:29.266593 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:29.267045 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:29.266592 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:29.267045 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:29.266669 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:29.267045 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:29.266762 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:31.265716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.265437 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:31.266129 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:31.265835 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:31.266129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.265936 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:31.266129 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:31.266046 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:31.266129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.266072 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:31.266331 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:31.266152 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:31.367710 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.367673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"d52ec35a2797f833affacfeeaaf504f9","Type":"ContainerStarted","Data":"569e9cfb5d98c6162db1105185e57fab8bbaade4716c4ea24b8db5404fe57b4a"} Jul 06 01:20:31.369083 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.369054 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtst8" event={"ID":"d0d5df89-8d1a-4758-830b-3d8da03c8283","Type":"ContainerStarted","Data":"4fabbb7e3cdd093d7d667e4cf5c4869672328d4ce65cb34286d331de42c4c633"} Jul 06 01:20:31.370612 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.370582 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqxp2" event={"ID":"6326da57-2656-4351-b417-b45cf45a621c","Type":"ContainerStarted","Data":"c394797e923d5ff3d2794834c6f84043503bd3a098ca084c8bd69cd2e2ed24f9"} Jul 06 01:20:31.374239 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.374215 2571 generic.go:356] "Generic (PLEG): container finished" podID="30197e12-318a-4318-98f4-f6e76de8f3db" containerID="64a59aa9a1b1fa392eb8828b478557c79f59679f944cfeed9bede7cb95304396" exitCode=0 Jul 06 01:20:31.374320 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.374300 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerDied","Data":"64a59aa9a1b1fa392eb8828b478557c79f59679f944cfeed9bede7cb95304396"} Jul 06 01:20:31.376027 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.376004 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ncsk8" event={"ID":"7cecfe8c-a378-41ca-9656-bceebfd3f60a","Type":"ContainerStarted","Data":"46ff88f5de5927fa1a32146efa2af1bed297ad13e50ef19413cbd7ae7962471c"} Jul 06 01:20:31.377440 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.377361 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qjs8x" event={"ID":"6d24bbed-1fab-473d-928a-e76a74b4780c","Type":"ContainerStarted","Data":"58951fe0a36ebc47c885e79fc0768adae6be3b8618dbd279fb1ab5a370f6ef82"} Jul 06 01:20:31.378892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.378872 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hq2kt" event={"ID":"d95d447d-2ac0-4646-b14e-6b4d6fc43d5c","Type":"ContainerStarted","Data":"481d3d92a9a12570f762db856bedd9d698f84fd172fc9443888226a3a3f4ec06"} Jul 06 01:20:31.380871 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.380843 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"ce53cc6eb4474f1893720f624a4f790a12b695189fa0ab70dfa71f6fac5e77bc"} Jul 06 01:20:31.403866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.403782 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" podStartSLOduration=21.403761213 podStartE2EDuration="21.403761213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:31.389403992 +0000 UTC m=+22.812207048" watchObservedRunningTime="2026-07-06 01:20:31.403761213 +0000 UTC m=+22.826564268" Jul 06 01:20:31.404193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.404160 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hq2kt" podStartSLOduration=2.682043258 podStartE2EDuration="22.404152626s" totalImagesPullingTime="19.722109368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:31.403721069 +0000 UTC m=+22.826524125" watchObservedRunningTime="2026-07-06 01:20:31.404152626 +0000 UTC m=+22.826955681" Jul 06 01:20:31.441442 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.441385 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qqxp2" podStartSLOduration=2.727636419 podStartE2EDuration="22.441365282s" totalImagesPullingTime="19.713728863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:31.440708326 +0000 UTC m=+22.863511380" watchObservedRunningTime="2026-07-06 01:20:31.441365282 +0000 UTC m=+22.864168341" Jul 06 01:20:31.456164 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.456122 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dtst8" podStartSLOduration=2.776208973 podStartE2EDuration="22.456103373s" totalImagesPullingTime="19.6798944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:31.455529981 +0000 UTC m=+22.878333035" watchObservedRunningTime="2026-07-06 01:20:31.456103373 +0000 UTC m=+22.878906428" Jul 06 01:20:31.469078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.469043 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qjs8x" podStartSLOduration=7.433110666 podStartE2EDuration="22.469029146s" totalImagesPullingTime="15.03591848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:31.468661925 +0000 UTC m=+22.891465014" watchObservedRunningTime="2026-07-06 01:20:31.469029146 +0000 UTC m=+22.891832200" Jul 06 01:20:31.481826 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:31.481786 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ncsk8" podStartSLOduration=2.7780367740000003 podStartE2EDuration="22.481770341s" totalImagesPullingTime="19.703733567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:31.481770622 +0000 UTC m=+22.904573676" watchObservedRunningTime="2026-07-06 01:20:31.481770341 +0000 UTC m=+22.904573390" Jul 06 01:20:32.109304 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.109062 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:32.385836 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.385771 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:20:32.386467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.386120 2571 generic.go:356] "Generic (PLEG): container finished" podID="44e5dc17-dc36-46ba-b633-32def067e505" containerID="add96615f8d9c05c83cffdfcef9349fda152cd29138e67518dd489b1637a9eb2" exitCode=1 Jul 06 01:20:32.386467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.386193 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"26ed3ef74b314b28ccdb388e7d498cc0205f2970e352ea8a33cbe5245cfbb930"} Jul 06 01:20:32.386467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.386268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"b1444b107ea9a23e46dc8c53b9c8d599f33cba2960b0b28b99486104e411d4bf"} Jul 06 01:20:32.386467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.386314 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"43f9703d1361c70f6ed6c1ef8c1d25f7658a565af2d949c1128d6f6cf13fd75a"} Jul 06 01:20:32.386467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.386344 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"af13e35f6dd3e8ca515a17b035fa28f327af01c3206c19b4f5caea322d7d3a6a"} Jul 06 01:20:32.386467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.386385 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerDied","Data":"add96615f8d9c05c83cffdfcef9349fda152cd29138e67518dd489b1637a9eb2"} Jul 06 01:20:32.387608 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.387581 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" event={"ID":"9ba2693c-c2fb-4810-b63b-639d251c80a0","Type":"ContainerStarted","Data":"4aed27c793ed20222f5469ddd47ec4707f2f6da8209e7c0f1404c1e9aab374d8"} Jul 06 01:20:32.783417 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:32.783387 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 01:20:33.199065 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.198842 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T01:20:32.783410681Z","UUID":"3ae8df2e-2b83-47cc-8ed3-f97adedf6e6a","Handler":null,"Name":"","Endpoint":""} Jul 06 01:20:33.203005 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.202981 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 01:20:33.203149 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.203033 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 01:20:33.265713 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.265677 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:33.265905 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.265677 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:33.265905 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:33.265808 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:33.265905 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.265847 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:33.266130 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:33.265970 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:33.266130 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:33.266071 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:33.391819 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.391784 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29bc7" event={"ID":"08838b2d-632c-448f-97d5-29f33c641071","Type":"ContainerStarted","Data":"b313a18ec53744cfb27cc0987d54b3f36f4e092a5dc73a1f788bcbbe091c1adb"} Jul 06 01:20:33.393465 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:33.393435 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" event={"ID":"9ba2693c-c2fb-4810-b63b-639d251c80a0","Type":"ContainerStarted","Data":"c1c92bbb1356f4e9094a21cb6b1eb9bca39d2727a67580b2f94b0f49bc9de94a"} Jul 06 01:20:34.399488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.399314 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:20:34.400032 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.399820 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"6e9ad16b618a53940057f0c1cbe5acf9775fb2c3c4b31714adf5f5d2c9498957"} Jul 06 01:20:34.402192 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.402163 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" event={"ID":"9ba2693c-c2fb-4810-b63b-639d251c80a0","Type":"ContainerStarted","Data":"400c4c7baae8a09533953b47dc12330d3041df723aa80a2fb4f1f64c5a29c71c"} Jul 06 01:20:34.420277 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.420218 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfgmx" podStartSLOduration=3.429431139 podStartE2EDuration="25.420198112s" totalImagesPullingTime="21.990766973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:34.419993556 +0000 UTC m=+25.842796613" watchObservedRunningTime="2026-07-06 01:20:34.420198112 +0000 UTC m=+25.843001168" Jul 06 01:20:34.420755 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.420726 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-29bc7" podStartSLOduration=10.353047086 podStartE2EDuration="25.420715154s" totalImagesPullingTime="15.067668068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:33.405129732 +0000 UTC m=+24.827932789" watchObservedRunningTime="2026-07-06 01:20:34.420715154 +0000 UTC m=+25.843518309" Jul 06 01:20:34.829884 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.829843 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:34.830523 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:34.830498 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:35.264889 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.264855 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:35.264889 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.264879 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:35.265183 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.265001 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:35.265183 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:35.265003 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:35.265183 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:35.265099 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:35.265183 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:35.265170 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:35.406462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.406431 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hq2kt" Jul 06 01:20:35.515066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.514978 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:35.606263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.606219 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:35.661587 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:35.661549 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:36.411381 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:36.411360 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:20:36.412229 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:36.411858 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"9ab656805b35fbb2a7b656f7956e96fdd8eb41a0546da0a8261c9833cf03b6c0"} Jul 06 01:20:36.412296 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:36.412252 2571 scope.go:117] "RemoveContainer" containerID="add96615f8d9c05c83cffdfcef9349fda152cd29138e67518dd489b1637a9eb2" Jul 06 01:20:37.265362 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.265332 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:37.265516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.265333 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:37.265516 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:37.265450 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:37.265612 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.265333 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:37.267996 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:37.265964 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:37.267996 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:37.266066 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:37.415737 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.415702 2571 generic.go:356] "Generic (PLEG): container finished" podID="30197e12-318a-4318-98f4-f6e76de8f3db" containerID="4eed1897fe1373dea71bcea35a5b4d77a56af82ecabecc3be2346d1901a34d6a" exitCode=0 Jul 06 01:20:37.416232 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.415787 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerDied","Data":"4eed1897fe1373dea71bcea35a5b4d77a56af82ecabecc3be2346d1901a34d6a"} Jul 06 01:20:37.419710 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.419694 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:20:37.420079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.420046 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" event={"ID":"44e5dc17-dc36-46ba-b633-32def067e505","Type":"ContainerStarted","Data":"b2b708195d9a07a4c15c2f0f63bba689ea086576e9ff56edfb3b34ce4e1e8b00"} Jul 06 01:20:37.420268 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.420249 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:37.420368 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.420311 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:37.420368 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.420362 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:37.435778 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.435751 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:37.436027 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.435861 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:20:37.459503 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:37.459452 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" podStartSLOduration=8.566354983 podStartE2EDuration="28.45943686s" totalImagesPullingTime="19.893081877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:37.459212653 +0000 UTC m=+28.882015708" watchObservedRunningTime="2026-07-06 01:20:37.45943686 +0000 UTC m=+28.882239906" Jul 06 01:20:38.261140 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:38.261102 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7fpk"] Jul 06 01:20:38.261322 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:38.261228 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:38.261372 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:38.261319 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:38.261574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:38.261553 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pp2g5"] Jul 06 01:20:38.261654 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:38.261643 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:38.261746 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:38.261726 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:38.262868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:38.262831 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jv4mv"] Jul 06 01:20:38.263022 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:38.262936 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:38.263088 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:38.263024 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:39.426101 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:39.426063 2571 generic.go:356] "Generic (PLEG): container finished" podID="30197e12-318a-4318-98f4-f6e76de8f3db" containerID="2795a4498ded64dde80de44d6f2889b19670e7749af3a3f18cbca525be270225" exitCode=0 Jul 06 01:20:39.426568 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:39.426156 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerDied","Data":"2795a4498ded64dde80de44d6f2889b19670e7749af3a3f18cbca525be270225"} Jul 06 01:20:40.009556 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:40.009495 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:40.065600 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:40.065558 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:40.265685 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:40.265618 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:40.265685 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:40.265640 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:40.265848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:40.265624 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:40.265848 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:40.265732 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:40.265848 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:40.265829 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:40.265981 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:40.265936 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:40.968777 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:40.968740 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:41.027370 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:41.027340 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:41.432967 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:41.432916 2571 generic.go:356] "Generic (PLEG): container finished" podID="30197e12-318a-4318-98f4-f6e76de8f3db" containerID="cece41f2c6f496b43039ae42b2c4a6fc24ee9de224ae0fecb74f6ecce0576296" exitCode=0 Jul 06 01:20:41.433116 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:41.432976 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerDied","Data":"cece41f2c6f496b43039ae42b2c4a6fc24ee9de224ae0fecb74f6ecce0576296"} Jul 06 01:20:42.264684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:42.264651 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:42.264684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:42.264671 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:42.265209 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:42.264784 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:42.265209 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.264804 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:42.265209 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.264876 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:42.265209 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.264978 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:42.751650 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:42.751612 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:42.751650 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:42.751656 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:42.751869 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.751762 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:42.751869 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.751778 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:20:42.751869 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.751805 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:20:42.751869 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.751818 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jprt6 for pod openshift-network-diagnostics/network-check-target-f7fpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:42.751869 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.751836 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs podName:f387a6c0-87c0-406d-a2c4-1e0c5081ad57 nodeName:}" failed. No retries permitted until 2026-07-06 01:21:14.751816515 +0000 UTC m=+66.174619552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs") pod "network-metrics-daemon-jv4mv" (UID: "f387a6c0-87c0-406d-a2c4-1e0c5081ad57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:20:42.751869 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.751852 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6 podName:2db6b082-87df-4c31-a812-2e38d9c17cdd nodeName:}" failed. No retries permitted until 2026-07-06 01:21:14.751842022 +0000 UTC m=+66.174645067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jprt6" (UniqueName: "kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6") pod "network-check-target-f7fpk" (UID: "2db6b082-87df-4c31-a812-2e38d9c17cdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:20:42.852202 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:42.852109 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:42.852363 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.852240 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:42.852363 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:42.852302 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret podName:81916daf-c70e-4cf0-afbc-6f9e5806ba00 nodeName:}" failed. No retries permitted until 2026-07-06 01:21:14.852284158 +0000 UTC m=+66.275087214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret") pod "global-pull-secret-syncer-pp2g5" (UID: "81916daf-c70e-4cf0-afbc-6f9e5806ba00") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:20:44.265364 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.265139 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:44.265779 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.265158 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:44.265779 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:44.265459 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7fpk" podUID="2db6b082-87df-4c31-a812-2e38d9c17cdd" Jul 06 01:20:44.265779 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.265187 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:44.265779 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:44.265558 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jv4mv" podUID="f387a6c0-87c0-406d-a2c4-1e0c5081ad57" Jul 06 01:20:44.265779 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:44.265634 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp2g5" podUID="81916daf-c70e-4cf0-afbc-6f9e5806ba00" Jul 06 01:20:44.908988 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.908938 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeReady" Jul 06 01:20:44.909146 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.909111 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 01:20:44.942469 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.942425 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fd69c4f65-6j2r8"] Jul 06 01:20:44.947605 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.947579 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:44.950238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.950016 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 01:20:44.950238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.950047 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 01:20:44.950238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.950025 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 01:20:44.950238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.950020 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qv997\"" Jul 06 01:20:44.951423 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.951371 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fltxm"] Jul 06 01:20:44.954666 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.954624 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:44.955293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.955264 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gslcw"] Jul 06 01:20:44.955868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.955848 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 01:20:44.959319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.958099 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 01:20:44.959319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.958465 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 01:20:44.959319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.958496 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b9srw\"" Jul 06 01:20:44.959319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.959230 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 01:20:44.959930 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.959910 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd69c4f65-6j2r8"] Jul 06 01:20:44.960048 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.960013 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:44.962221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.962085 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g4lpx\"" Jul 06 01:20:44.962221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.962121 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 01:20:44.962221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.962142 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 01:20:44.963428 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.963403 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fltxm"] Jul 06 01:20:44.966529 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:44.966362 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gslcw"] Jul 06 01:20:45.068489 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068445 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4p8c\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-kube-api-access-w4p8c\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.068667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068499 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88699494-8f67-4d0a-bbe8-95758c86285c-ca-trust-extracted\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.068667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068616 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e442a372-ef1f-45de-960f-31b7416fd01b-tmp-dir\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.068667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068649 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b7146d6-1469-40b2-9631-295badf7e234-cert\") pod \"ingress-canary-fltxm\" (UID: \"4b7146d6-1469-40b2-9631-295badf7e234\") " pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.068667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068665 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a372-ef1f-45de-960f-31b7416fd01b-config-volume\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.068832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068704 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-trusted-ca\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.068832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068730 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.068832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068756 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-image-registry-private-configuration\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.068832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068798 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.068832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068826 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-registry-certificates\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.069039 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068852 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-bound-sa-token\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.069039 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068896 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-installation-pull-secrets\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.069039 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068921 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcn29\" (UniqueName: \"kubernetes.io/projected/e442a372-ef1f-45de-960f-31b7416fd01b-kube-api-access-vcn29\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.069039 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.068963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6qtd\" (UniqueName: \"kubernetes.io/projected/4b7146d6-1469-40b2-9631-295badf7e234-kube-api-access-g6qtd\") pod \"ingress-canary-fltxm\" (UID: \"4b7146d6-1469-40b2-9631-295badf7e234\") " pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.098097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.098056 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:45.154656 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.154622 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:45.169600 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169528 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-image-registry-private-configuration\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.169600 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169565 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.169600 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169589 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-registry-certificates\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.169834 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.169708 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:20:45.169834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169718 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-bound-sa-token\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.169834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169787 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-installation-pull-secrets\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.169834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169818 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcn29\" (UniqueName: \"kubernetes.io/projected/e442a372-ef1f-45de-960f-31b7416fd01b-kube-api-access-vcn29\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.170009 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.169731 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69c4f65-6j2r8: secret "image-registry-tls" not found Jul 06 01:20:45.170009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169854 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6qtd\" (UniqueName: \"kubernetes.io/projected/4b7146d6-1469-40b2-9631-295badf7e234-kube-api-access-g6qtd\") pod \"ingress-canary-fltxm\" (UID: \"4b7146d6-1469-40b2-9631-295badf7e234\") " pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.170009 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.169907 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls podName:88699494-8f67-4d0a-bbe8-95758c86285c nodeName:}" failed. No retries permitted until 2026-07-06 01:20:45.669884273 +0000 UTC m=+37.092687322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls") pod "image-registry-5fd69c4f65-6j2r8" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c") : secret "image-registry-tls" not found Jul 06 01:20:45.170009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169933 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4p8c\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-kube-api-access-w4p8c\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.170009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.169993 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88699494-8f67-4d0a-bbe8-95758c86285c-ca-trust-extracted\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.170238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170047 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e442a372-ef1f-45de-960f-31b7416fd01b-tmp-dir\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.170238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170087 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b7146d6-1469-40b2-9631-295badf7e234-cert\") pod \"ingress-canary-fltxm\" (UID: \"4b7146d6-1469-40b2-9631-295badf7e234\") " pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.170238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170111 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a372-ef1f-45de-960f-31b7416fd01b-config-volume\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.170238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170155 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-trusted-ca\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.170238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170180 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.170238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170179 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-registry-certificates\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.170511 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170371 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88699494-8f67-4d0a-bbe8-95758c86285c-ca-trust-extracted\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.170511 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170504 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e442a372-ef1f-45de-960f-31b7416fd01b-tmp-dir\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.170695 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.170675 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:20:45.170781 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.170742 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls podName:e442a372-ef1f-45de-960f-31b7416fd01b nodeName:}" failed. No retries permitted until 2026-07-06 01:20:45.670721087 +0000 UTC m=+37.093524131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls") pod "dns-default-gslcw" (UID: "e442a372-ef1f-45de-960f-31b7416fd01b") : secret "dns-default-metrics-tls" not found Jul 06 01:20:45.170897 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.170875 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a372-ef1f-45de-960f-31b7416fd01b-config-volume\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.171709 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.171691 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-trusted-ca\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.174401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.174256 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-installation-pull-secrets\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.174401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.174319 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-image-registry-private-configuration\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.174401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.174365 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b7146d6-1469-40b2-9631-295badf7e234-cert\") pod \"ingress-canary-fltxm\" (UID: \"4b7146d6-1469-40b2-9631-295badf7e234\") " pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.180714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.180585 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4p8c\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-kube-api-access-w4p8c\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.180812 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.180722 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcn29\" (UniqueName: \"kubernetes.io/projected/e442a372-ef1f-45de-960f-31b7416fd01b-kube-api-access-vcn29\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.181106 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.181088 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-bound-sa-token\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.181295 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.181261 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6qtd\" (UniqueName: \"kubernetes.io/projected/4b7146d6-1469-40b2-9631-295badf7e234-kube-api-access-g6qtd\") pod \"ingress-canary-fltxm\" (UID: \"4b7146d6-1469-40b2-9631-295badf7e234\") " pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.270885 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.270852 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fltxm" Jul 06 01:20:45.674394 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.674354 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:45.674583 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:45.674405 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:45.674583 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.674472 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:20:45.674583 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.674515 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:20:45.674583 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.674533 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69c4f65-6j2r8: secret "image-registry-tls" not found Jul 06 01:20:45.674583 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.674561 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls podName:e442a372-ef1f-45de-960f-31b7416fd01b nodeName:}" failed. No retries permitted until 2026-07-06 01:20:46.674543361 +0000 UTC m=+38.097346395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls") pod "dns-default-gslcw" (UID: "e442a372-ef1f-45de-960f-31b7416fd01b") : secret "dns-default-metrics-tls" not found Jul 06 01:20:45.674583 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:45.674577 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls podName:88699494-8f67-4d0a-bbe8-95758c86285c nodeName:}" failed. No retries permitted until 2026-07-06 01:20:46.674570816 +0000 UTC m=+38.097373849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls") pod "image-registry-5fd69c4f65-6j2r8" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c") : secret "image-registry-tls" not found Jul 06 01:20:46.265593 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.265557 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:20:46.265714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.265587 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:20:46.265714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.265590 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:20:46.268103 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.268082 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 01:20:46.268103 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.268095 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 01:20:46.268989 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.268963 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 01:20:46.269091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.268991 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9bqkt\"" Jul 06 01:20:46.269091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.268969 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 01:20:46.269091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.269061 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6kdr7\"" Jul 06 01:20:46.273306 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.273284 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fltxm"] Jul 06 01:20:46.277995 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:46.277970 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7146d6_1469_40b2_9631_295badf7e234.slice/crio-8ffb86e42e19f0e13dc1a8e300ee8909e2e37ad339f8d2952adcf81f34a13596 WatchSource:0}: Error finding container 8ffb86e42e19f0e13dc1a8e300ee8909e2e37ad339f8d2952adcf81f34a13596: Status 404 returned error can't find the container with id 8ffb86e42e19f0e13dc1a8e300ee8909e2e37ad339f8d2952adcf81f34a13596 Jul 06 01:20:46.447900 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.447864 2571 generic.go:356] "Generic (PLEG): container finished" podID="30197e12-318a-4318-98f4-f6e76de8f3db" containerID="cba8de269292253a9b711ca7d8f81822805072680951dc937d044bae15aa6c75" exitCode=0 Jul 06 01:20:46.448031 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.447960 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerDied","Data":"cba8de269292253a9b711ca7d8f81822805072680951dc937d044bae15aa6c75"} Jul 06 01:20:46.449032 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.448998 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fltxm" event={"ID":"4b7146d6-1469-40b2-9631-295badf7e234","Type":"ContainerStarted","Data":"8ffb86e42e19f0e13dc1a8e300ee8909e2e37ad339f8d2952adcf81f34a13596"} Jul 06 01:20:46.682810 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.682773 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:46.683066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:46.682819 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:46.683066 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:46.682928 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:20:46.683066 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:46.683056 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69c4f65-6j2r8: secret "image-registry-tls" not found Jul 06 01:20:46.683281 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:46.682931 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:20:46.683281 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:46.683120 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls podName:88699494-8f67-4d0a-bbe8-95758c86285c nodeName:}" failed. No retries permitted until 2026-07-06 01:20:48.683101471 +0000 UTC m=+40.105904526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls") pod "image-registry-5fd69c4f65-6j2r8" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c") : secret "image-registry-tls" not found Jul 06 01:20:46.683281 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:46.683195 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls podName:e442a372-ef1f-45de-960f-31b7416fd01b nodeName:}" failed. No retries permitted until 2026-07-06 01:20:48.683180509 +0000 UTC m=+40.105983542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls") pod "dns-default-gslcw" (UID: "e442a372-ef1f-45de-960f-31b7416fd01b") : secret "dns-default-metrics-tls" not found Jul 06 01:20:47.454771 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:47.454717 2571 generic.go:356] "Generic (PLEG): container finished" podID="30197e12-318a-4318-98f4-f6e76de8f3db" containerID="28fe629378a19f0a18bb3b8e9284be30549e807fa6634c00f700a2daecc7b411" exitCode=0 Jul 06 01:20:47.455482 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:47.454786 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerDied","Data":"28fe629378a19f0a18bb3b8e9284be30549e807fa6634c00f700a2daecc7b411"} Jul 06 01:20:48.359266 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.359225 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:48.461715 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.460751 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" event={"ID":"30197e12-318a-4318-98f4-f6e76de8f3db","Type":"ContainerStarted","Data":"4168ab30852e1ed846d420a6726487e26822d23538f9af5b05e517d54d32b015"} Jul 06 01:20:48.482000 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.481855 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6jgv2" podStartSLOduration=7.869413696 podStartE2EDuration="39.481835795s" totalImagesPullingTime="31.612422099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:48.480499765 +0000 UTC m=+39.903302841" watchObservedRunningTime="2026-07-06 01:20:48.481835795 +0000 UTC m=+39.904638854" Jul 06 01:20:48.601343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.601310 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:48.657671 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.657590 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:48.700827 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.700794 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:48.700988 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.700838 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:48.700988 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:48.700934 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:20:48.701112 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:48.701003 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls podName:e442a372-ef1f-45de-960f-31b7416fd01b nodeName:}" failed. No retries permitted until 2026-07-06 01:20:52.700987933 +0000 UTC m=+44.123790966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls") pod "dns-default-gslcw" (UID: "e442a372-ef1f-45de-960f-31b7416fd01b") : secret "dns-default-metrics-tls" not found Jul 06 01:20:48.701112 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:48.701012 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:20:48.701112 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:48.701027 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69c4f65-6j2r8: secret "image-registry-tls" not found Jul 06 01:20:48.701112 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:48.701075 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls podName:88699494-8f67-4d0a-bbe8-95758c86285c nodeName:}" failed. No retries permitted until 2026-07-06 01:20:52.701059334 +0000 UTC m=+44.123862385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls") pod "image-registry-5fd69c4f65-6j2r8" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c") : secret "image-registry-tls" not found Jul 06 01:20:48.709538 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.709513 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:48.821923 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:48.821893 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:49.254901 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:49.254825 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:49.313311 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:49.313265 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:49.465451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:49.465411 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fltxm" event={"ID":"4b7146d6-1469-40b2-9631-295badf7e234","Type":"ContainerStarted","Data":"64a2c33c865386c5f1af456c58f1a520d1ef1fa5b8c67c367c5a1ba332e013e9"} Jul 06 01:20:49.481354 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:49.481309 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fltxm" podStartSLOduration=2.939623598 podStartE2EDuration="5.481293226s" totalImagesPullingTime="2.541669628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:49.480282159 +0000 UTC m=+40.903085214" watchObservedRunningTime="2026-07-06 01:20:49.481293226 +0000 UTC m=+40.904096281" Jul 06 01:20:49.542046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:49.541965 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:49.643549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:49.643516 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:51.137912 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.137875 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bwd4x"] Jul 06 01:20:51.153196 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.153164 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bwd4x"] Jul 06 01:20:51.153321 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.153279 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.155616 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.155590 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 01:20:51.156675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.156653 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 01:20:51.157180 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.157148 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-z825r\"" Jul 06 01:20:51.157180 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.156698 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 01:20:51.160301 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.157842 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 01:20:51.162432 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.162413 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:51.218888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.218853 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:51.321018 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.320989 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-signing-cabundle\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.321169 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.321021 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bl8f\" (UniqueName: \"kubernetes.io/projected/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-kube-api-access-9bl8f\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.321169 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.321071 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-signing-key\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.422307 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.422278 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-signing-cabundle\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.422416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.422314 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bl8f\" (UniqueName: \"kubernetes.io/projected/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-kube-api-access-9bl8f\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.422416 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.422366 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-signing-key\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.423095 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.423067 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-signing-cabundle\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.425772 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.425746 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-signing-key\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.429914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.429893 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bl8f\" (UniqueName: \"kubernetes.io/projected/51a5e48d-92ee-4fd1-9e1e-6239fcf84a35-kube-api-access-9bl8f\") pod \"service-ca-758f599c5-bwd4x\" (UID: \"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35\") " pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.463891 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.463866 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-bwd4x" Jul 06 01:20:51.527679 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.527643 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:51.594539 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.594511 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:51.615724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.615697 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bwd4x"] Jul 06 01:20:51.618925 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:20:51.618902 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a5e48d_92ee_4fd1_9e1e_6239fcf84a35.slice/crio-9109497f94f73dc6139ec876c283e380d0a951d84b64b4a63f2c379685972109 WatchSource:0}: Error finding container 9109497f94f73dc6139ec876c283e380d0a951d84b64b4a63f2c379685972109: Status 404 returned error can't find the container with id 9109497f94f73dc6139ec876c283e380d0a951d84b64b4a63f2c379685972109 Jul 06 01:20:51.698468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.698366 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:51.796759 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:51.796727 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:52.038218 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:52.038128 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:52.474070 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:52.474030 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-bwd4x" event={"ID":"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35","Type":"ContainerStarted","Data":"9109497f94f73dc6139ec876c283e380d0a951d84b64b4a63f2c379685972109"} Jul 06 01:20:52.732505 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:52.732418 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:20:52.732505 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:52.732469 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:20:52.732728 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:52.732595 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:20:52.732728 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:52.732613 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:20:52.732728 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:52.732629 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69c4f65-6j2r8: secret "image-registry-tls" not found Jul 06 01:20:52.732728 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:52.732664 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls podName:e442a372-ef1f-45de-960f-31b7416fd01b nodeName:}" failed. No retries permitted until 2026-07-06 01:21:00.732648131 +0000 UTC m=+52.155451165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls") pod "dns-default-gslcw" (UID: "e442a372-ef1f-45de-960f-31b7416fd01b") : secret "dns-default-metrics-tls" not found Jul 06 01:20:52.732728 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:20:52.732687 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls podName:88699494-8f67-4d0a-bbe8-95758c86285c nodeName:}" failed. No retries permitted until 2026-07-06 01:21:00.73267092 +0000 UTC m=+52.155473970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls") pod "image-registry-5fd69c4f65-6j2r8" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c") : secret "image-registry-tls" not found Jul 06 01:20:54.481837 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.481138 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-bwd4x" event={"ID":"51a5e48d-92ee-4fd1-9e1e-6239fcf84a35","Type":"ContainerStarted","Data":"eca7cf1801119347d955afe7f4c54fa2d95e7cb5a442370b1ab605cd62935347"} Jul 06 01:20:54.515909 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.515855 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-bwd4x" podStartSLOduration=1.433151841 podStartE2EDuration="3.515838004s" totalImagesPullingTime="2.082686163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:20:54.515039376 +0000 UTC m=+45.937842433" watchObservedRunningTime="2026-07-06 01:20:54.515838004 +0000 UTC m=+45.938641058" Jul 06 01:20:54.612633 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.612598 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:54.710049 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.710014 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:54.821099 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.821013 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:54.923403 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.923352 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:54.975836 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:54.975783 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:56.104180 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:56.104147 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:56.298044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:56.298005 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:56.505370 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:56.505334 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:56.701281 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:56.701246 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:56.897868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:56.897776 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:57.901800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:57.901766 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:57.955025 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:57.954986 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:58.299423 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:58.299388 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:58.400559 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:58.400524 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:58.500860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:58.500828 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:58.557820 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:58.557732 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:58.704091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:58.704055 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:59.099534 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:59.099497 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:59.152086 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:59.152052 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:59.506025 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:20:59.505992 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:00.299588 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.299549 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:00.705540 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.705507 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:00.790885 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.790848 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:21:00.790885 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.790887 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:21:00.793202 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.793174 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442a372-ef1f-45de-960f-31b7416fd01b-metrics-tls\") pod \"dns-default-gslcw\" (UID: \"e442a372-ef1f-45de-960f-31b7416fd01b\") " pod="openshift-dns/dns-default-gslcw" Jul 06 01:21:00.793308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.793280 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"image-registry-5fd69c4f65-6j2r8\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:21:00.862233 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.862194 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:21:00.876758 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.876725 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gslcw" Jul 06 01:21:00.901387 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:00.901356 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:01.045933 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.045740 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd69c4f65-6j2r8"] Jul 06 01:21:01.049218 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:01.049188 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88699494_8f67_4d0a_bbe8_95758c86285c.slice/crio-33ada79f7f86d6c0ef61791f2ff8b89d7b3c5877d59ba3f3d26415fd1bc8d18c WatchSource:0}: Error finding container 33ada79f7f86d6c0ef61791f2ff8b89d7b3c5877d59ba3f3d26415fd1bc8d18c: Status 404 returned error can't find the container with id 33ada79f7f86d6c0ef61791f2ff8b89d7b3c5877d59ba3f3d26415fd1bc8d18c Jul 06 01:21:01.064697 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.064663 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gslcw"] Jul 06 01:21:01.066771 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:01.066728 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode442a372_ef1f_45de_960f_31b7416fd01b.slice/crio-494acad1fad25b4b5e7f8bdca20419d9873fe74d4d9ca8c1d14a5b22689280de WatchSource:0}: Error finding container 494acad1fad25b4b5e7f8bdca20419d9873fe74d4d9ca8c1d14a5b22689280de: Status 404 returned error can't find the container with id 494acad1fad25b4b5e7f8bdca20419d9873fe74d4d9ca8c1d14a5b22689280de Jul 06 01:21:01.123482 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.123439 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:01.223795 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.223705 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:01.501563 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.501467 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gslcw" event={"ID":"e442a372-ef1f-45de-960f-31b7416fd01b","Type":"ContainerStarted","Data":"494acad1fad25b4b5e7f8bdca20419d9873fe74d4d9ca8c1d14a5b22689280de"} Jul 06 01:21:01.503254 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.503212 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" event={"ID":"88699494-8f67-4d0a-bbe8-95758c86285c","Type":"ContainerStarted","Data":"6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded"} Jul 06 01:21:01.503374 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.503263 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" event={"ID":"88699494-8f67-4d0a-bbe8-95758c86285c","Type":"ContainerStarted","Data":"33ada79f7f86d6c0ef61791f2ff8b89d7b3c5877d59ba3f3d26415fd1bc8d18c"} Jul 06 01:21:01.503374 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.503363 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:01.503488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.503423 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:21:01.524087 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:01.524029 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" podStartSLOduration=58.52400834 podStartE2EDuration="58.52400834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:01.523612212 +0000 UTC m=+52.946415286" watchObservedRunningTime="2026-07-06 01:21:01.52400834 +0000 UTC m=+52.946811394" Jul 06 01:21:02.099665 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:02.099633 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:02.697647 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:02.697614 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:02.921935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:02.921888 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:03.300579 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:03.300549 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:03.498780 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:03.498746 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:03.905854 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:03.905752 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:04.301256 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.301220 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:04.513601 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.513567 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gslcw" event={"ID":"e442a372-ef1f-45de-960f-31b7416fd01b","Type":"ContainerStarted","Data":"9aad8477efd552dadb719f437d8747335ee87b23a17724cc31bdfbe2b6fcdf52"} Jul 06 01:21:04.513790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.513616 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gslcw" event={"ID":"e442a372-ef1f-45de-960f-31b7416fd01b","Type":"ContainerStarted","Data":"136e3ff541670c23b26b6e60e965050fec04665b653aa974d3f224d4b0924888"} Jul 06 01:21:04.513790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.513684 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gslcw" Jul 06 01:21:04.530043 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.529996 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gslcw" podStartSLOduration=18.115509207 podStartE2EDuration="20.529981466s" totalImagesPullingTime="2.414472259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:04.528754987 +0000 UTC m=+55.951558043" watchObservedRunningTime="2026-07-06 01:21:04.529981466 +0000 UTC m=+55.952784518" Jul 06 01:21:04.703207 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.703161 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:04.896713 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:04.896674 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:09.440702 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:09.440671 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xlzn7" Jul 06 01:21:13.498704 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.498655 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq"] Jul 06 01:21:13.501556 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.501527 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf"] Jul 06 01:21:13.501676 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.501655 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.503195 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.503177 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t"] Jul 06 01:21:13.503299 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.503281 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" Jul 06 01:21:13.504398 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504379 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.504494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504429 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 01:21:13.504494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504463 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.504611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504463 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k7w57\"" Jul 06 01:21:13.504755 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504736 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d6c8bb4bf-h6nxl"] Jul 06 01:21:13.504755 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504752 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 01:21:13.504838 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.504821 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.505237 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.505224 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.505632 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.505618 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.505792 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.505631 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tfp5n\"" Jul 06 01:21:13.506453 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.506437 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7f6bq"] Jul 06 01:21:13.506553 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.506539 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.507242 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.507222 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.507453 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.507430 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.507550 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.507455 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 01:21:13.507550 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.507505 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hgfxt\"" Jul 06 01:21:13.508475 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.508450 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 01:21:13.508475 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.508469 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.508743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.508697 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 01:21:13.508743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.508712 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.509402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.509116 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 01:21:13.509402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.509120 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-74s4z\"" Jul 06 01:21:13.509402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.509251 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 01:21:13.509402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.509292 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.510823 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.510806 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.511835 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.511816 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wgcb8\"" Jul 06 01:21:13.512061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.512047 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.512061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.512056 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 01:21:13.512271 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.512255 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 01:21:13.515463 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.515445 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf"] Jul 06 01:21:13.517829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.517811 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq"] Jul 06 01:21:13.519846 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.519823 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 01:21:13.520285 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.520268 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7f6bq"] Jul 06 01:21:13.521207 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.521189 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d6c8bb4bf-h6nxl"] Jul 06 01:21:13.550738 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.550710 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t"] Jul 06 01:21:13.587410 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587377 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2g4\" (UniqueName: \"kubernetes.io/projected/12a60772-75d1-4849-845e-2640af63efa9-kube-api-access-hz2g4\") pod \"volume-data-source-validator-5d456fdbcd-wwvrf\" (UID: \"12a60772-75d1-4849-845e-2640af63efa9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" Jul 06 01:21:13.587572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587416 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-metrics-certs\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.587572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685rq\" (UniqueName: \"kubernetes.io/projected/8703fecb-fd27-4224-999b-fb548d74d493-kube-api-access-685rq\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.587572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587496 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8703fecb-fd27-4224-999b-fb548d74d493-tmp\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.587572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587533 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8703fecb-fd27-4224-999b-fb548d74d493-snapshots\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.587572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587564 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8703fecb-fd27-4224-999b-fb548d74d493-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.587769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587580 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8703fecb-fd27-4224-999b-fb548d74d493-serving-cert\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.587769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587610 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-default-certificate\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.587769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587647 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df104202-ae4e-4716-869d-ac91e7b6c754-service-ca-bundle\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.587769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587706 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8703fecb-fd27-4224-999b-fb548d74d493-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.587769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587728 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.587769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587754 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.588088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587773 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzljf\" (UniqueName: \"kubernetes.io/projected/8d5b36d3-986a-4037-9cd1-4830d8145141-kube-api-access-lzljf\") pod \"cluster-samples-operator-56fcf86bf-sk98t\" (UID: \"8d5b36d3-986a-4037-9cd1-4830d8145141\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.588088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587833 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d5b36d3-986a-4037-9cd1-4830d8145141-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sk98t\" (UID: \"8d5b36d3-986a-4037-9cd1-4830d8145141\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.588088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587864 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skckk\" (UniqueName: \"kubernetes.io/projected/df104202-ae4e-4716-869d-ac91e7b6c754-kube-api-access-skckk\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.588088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587901 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-stats-auth\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.588088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.587924 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29pz4\" (UniqueName: \"kubernetes.io/projected/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-kube-api-access-29pz4\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.606543 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.606516 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h"] Jul 06 01:21:13.608522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.608506 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.612733 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.612526 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.615768 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.613599 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 01:21:13.615768 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.613969 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.615768 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.614284 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lnp4x\"" Jul 06 01:21:13.615768 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.614546 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 01:21:13.618190 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.618163 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-522fr"] Jul 06 01:21:13.619817 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.619803 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.623987 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.623968 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 01:21:13.624319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.624298 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:21:13.624417 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.624374 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2rghw\"" Jul 06 01:21:13.624417 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.624308 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 01:21:13.624719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.624698 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h"] Jul 06 01:21:13.625927 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.625810 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 01:21:13.630318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.630303 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 01:21:13.637047 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.637021 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-522fr"] Jul 06 01:21:13.681038 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.681011 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:13.688476 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688445 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df104202-ae4e-4716-869d-ac91e7b6c754-service-ca-bundle\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.688587 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688480 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c15a41a7-ff32-40f5-a8eb-d01874588ac5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.688587 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688519 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8703fecb-fd27-4224-999b-fb548d74d493-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.688703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688594 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.688703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688662 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.688703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688696 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fc3422c-f065-4485-9b06-13c101fbb3f4-config\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.688853 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688725 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzljf\" (UniqueName: \"kubernetes.io/projected/8d5b36d3-986a-4037-9cd1-4830d8145141-kube-api-access-lzljf\") pod \"cluster-samples-operator-56fcf86bf-sk98t\" (UID: \"8d5b36d3-986a-4037-9cd1-4830d8145141\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.688853 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688753 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d5b36d3-986a-4037-9cd1-4830d8145141-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sk98t\" (UID: \"8d5b36d3-986a-4037-9cd1-4830d8145141\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.688853 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skckk\" (UniqueName: \"kubernetes.io/projected/df104202-ae4e-4716-869d-ac91e7b6c754-kube-api-access-skckk\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.688853 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688808 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-stats-auth\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.689099 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.688974 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29pz4\" (UniqueName: \"kubernetes.io/projected/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-kube-api-access-29pz4\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.689099 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689034 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2g4\" (UniqueName: \"kubernetes.io/projected/12a60772-75d1-4849-845e-2640af63efa9-kube-api-access-hz2g4\") pod \"volume-data-source-validator-5d456fdbcd-wwvrf\" (UID: \"12a60772-75d1-4849-845e-2640af63efa9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" Jul 06 01:21:13.689099 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689069 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdj7\" (UniqueName: \"kubernetes.io/projected/5fc3422c-f065-4485-9b06-13c101fbb3f4-kube-api-access-6pdj7\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.689245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689117 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-metrics-certs\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.689245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689142 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fc3422c-f065-4485-9b06-13c101fbb3f4-trusted-ca\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.689245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685rq\" (UniqueName: \"kubernetes.io/projected/8703fecb-fd27-4224-999b-fb548d74d493-kube-api-access-685rq\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.689245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689216 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c15a41a7-ff32-40f5-a8eb-d01874588ac5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.689496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689262 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5bt6\" (UniqueName: \"kubernetes.io/projected/c15a41a7-ff32-40f5-a8eb-d01874588ac5-kube-api-access-b5bt6\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.689496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689290 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8703fecb-fd27-4224-999b-fb548d74d493-tmp\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.689496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689319 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8703fecb-fd27-4224-999b-fb548d74d493-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.689496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689345 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8703fecb-fd27-4224-999b-fb548d74d493-snapshots\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.689496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689387 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df104202-ae4e-4716-869d-ac91e7b6c754-service-ca-bundle\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.689496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689392 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.689839 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689750 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8703fecb-fd27-4224-999b-fb548d74d493-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.689890 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689833 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8703fecb-fd27-4224-999b-fb548d74d493-tmp\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.689890 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689883 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8703fecb-fd27-4224-999b-fb548d74d493-serving-cert\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.690010 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.689973 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-default-certificate\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.690010 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.690002 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fc3422c-f065-4485-9b06-13c101fbb3f4-serving-cert\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.690238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.690213 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8703fecb-fd27-4224-999b-fb548d74d493-snapshots\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.690612 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.690584 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8703fecb-fd27-4224-999b-fb548d74d493-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.691385 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.691364 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.691606 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.691583 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d5b36d3-986a-4037-9cd1-4830d8145141-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sk98t\" (UID: \"8d5b36d3-986a-4037-9cd1-4830d8145141\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.691775 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.691752 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-stats-auth\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.692098 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.692067 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-metrics-certs\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.692382 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.692366 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8703fecb-fd27-4224-999b-fb548d74d493-serving-cert\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.692837 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.692817 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/df104202-ae4e-4716-869d-ac91e7b6c754-default-certificate\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.699173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.699149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29pz4\" (UniqueName: \"kubernetes.io/projected/5b431f0d-3a72-41ff-bf8c-f0c89b6ba671-kube-api-access-29pz4\") pod \"kube-storage-version-migrator-operator-846bf668f7-b2jwq\" (UID: \"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.699596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.699577 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skckk\" (UniqueName: \"kubernetes.io/projected/df104202-ae4e-4716-869d-ac91e7b6c754-kube-api-access-skckk\") pod \"router-default-5d6c8bb4bf-h6nxl\" (UID: \"df104202-ae4e-4716-869d-ac91e7b6c754\") " pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.702834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.702813 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2g4\" (UniqueName: \"kubernetes.io/projected/12a60772-75d1-4849-845e-2640af63efa9-kube-api-access-hz2g4\") pod \"volume-data-source-validator-5d456fdbcd-wwvrf\" (UID: \"12a60772-75d1-4849-845e-2640af63efa9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" Jul 06 01:21:13.704366 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.704346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzljf\" (UniqueName: \"kubernetes.io/projected/8d5b36d3-986a-4037-9cd1-4830d8145141-kube-api-access-lzljf\") pod \"cluster-samples-operator-56fcf86bf-sk98t\" (UID: \"8d5b36d3-986a-4037-9cd1-4830d8145141\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.704982 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.704935 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-685rq\" (UniqueName: \"kubernetes.io/projected/8703fecb-fd27-4224-999b-fb548d74d493-kube-api-access-685rq\") pod \"insights-operator-5c847dcfc4-7f6bq\" (UID: \"8703fecb-fd27-4224-999b-fb548d74d493\") " pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.790418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790336 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fc3422c-f065-4485-9b06-13c101fbb3f4-config\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.790418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790379 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdj7\" (UniqueName: \"kubernetes.io/projected/5fc3422c-f065-4485-9b06-13c101fbb3f4-kube-api-access-6pdj7\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.790418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790399 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fc3422c-f065-4485-9b06-13c101fbb3f4-trusted-ca\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.790676 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790423 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c15a41a7-ff32-40f5-a8eb-d01874588ac5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.790676 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790450 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5bt6\" (UniqueName: \"kubernetes.io/projected/c15a41a7-ff32-40f5-a8eb-d01874588ac5-kube-api-access-b5bt6\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.790676 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790504 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fc3422c-f065-4485-9b06-13c101fbb3f4-serving-cert\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.790676 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.790529 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c15a41a7-ff32-40f5-a8eb-d01874588ac5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.791173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.791141 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c15a41a7-ff32-40f5-a8eb-d01874588ac5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.791173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.791159 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fc3422c-f065-4485-9b06-13c101fbb3f4-config\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.791338 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.791284 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fc3422c-f065-4485-9b06-13c101fbb3f4-trusted-ca\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.792927 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.792907 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fc3422c-f065-4485-9b06-13c101fbb3f4-serving-cert\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.793040 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.793008 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c15a41a7-ff32-40f5-a8eb-d01874588ac5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.802996 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.802976 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdj7\" (UniqueName: \"kubernetes.io/projected/5fc3422c-f065-4485-9b06-13c101fbb3f4-kube-api-access-6pdj7\") pod \"console-operator-68b757fb67-522fr\" (UID: \"5fc3422c-f065-4485-9b06-13c101fbb3f4\") " pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.803102 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.803016 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5bt6\" (UniqueName: \"kubernetes.io/projected/c15a41a7-ff32-40f5-a8eb-d01874588ac5-kube-api-access-b5bt6\") pod \"cluster-monitoring-operator-64786d9cbb-6t92h\" (UID: \"c15a41a7-ff32-40f5-a8eb-d01874588ac5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.813474 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.813457 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" Jul 06 01:21:13.821137 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.821113 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" Jul 06 01:21:13.828094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.828075 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" Jul 06 01:21:13.834067 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.834045 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:13.838026 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.837824 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" Jul 06 01:21:13.873869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.873592 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:13.924893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.922901 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" Jul 06 01:21:13.929449 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.929265 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:13.970833 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.970744 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:13.991486 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:13.991381 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq"] Jul 06 01:21:13.997480 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:13.997435 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b431f0d_3a72_41ff_bf8c_f0c89b6ba671.slice/crio-852b1f905549af4d0fa8eb7648d4e4e150e693dcb332e594465611762bb9922c WatchSource:0}: Error finding container 852b1f905549af4d0fa8eb7648d4e4e150e693dcb332e594465611762bb9922c: Status 404 returned error can't find the container with id 852b1f905549af4d0fa8eb7648d4e4e150e693dcb332e594465611762bb9922c Jul 06 01:21:14.008784 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.008688 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf"] Jul 06 01:21:14.036090 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.035897 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t"] Jul 06 01:21:14.058076 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.057882 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d6c8bb4bf-h6nxl"] Jul 06 01:21:14.066410 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.066340 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7f6bq"] Jul 06 01:21:14.079187 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:14.079029 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf104202_ae4e_4716_869d_ac91e7b6c754.slice/crio-a9fcee012643aab73d4a4cf66f6934c065196c932775dd627c8665634db5abf0 WatchSource:0}: Error finding container a9fcee012643aab73d4a4cf66f6934c065196c932775dd627c8665634db5abf0: Status 404 returned error can't find the container with id a9fcee012643aab73d4a4cf66f6934c065196c932775dd627c8665634db5abf0 Jul 06 01:21:14.108693 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.108667 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-522fr"] Jul 06 01:21:14.112028 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:14.111999 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc3422c_f065_4485_9b06_13c101fbb3f4.slice/crio-16d3370a3c693ca074be5dd824b21f17adbfaa50d05f7bdac5b802b9874f1d49 WatchSource:0}: Error finding container 16d3370a3c693ca074be5dd824b21f17adbfaa50d05f7bdac5b802b9874f1d49: Status 404 returned error can't find the container with id 16d3370a3c693ca074be5dd824b21f17adbfaa50d05f7bdac5b802b9874f1d49 Jul 06 01:21:14.124894 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.124872 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h"] Jul 06 01:21:14.127659 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:14.127630 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15a41a7_ff32_40f5_a8eb_d01874588ac5.slice/crio-931b343b63707277753d645fbd21dd5b598ca5a519e098c5aad13ec87e5f64e3 WatchSource:0}: Error finding container 931b343b63707277753d645fbd21dd5b598ca5a519e098c5aad13ec87e5f64e3: Status 404 returned error can't find the container with id 931b343b63707277753d645fbd21dd5b598ca5a519e098c5aad13ec87e5f64e3 Jul 06 01:21:14.520517 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.520037 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gslcw" Jul 06 01:21:14.550402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.550320 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" event={"ID":"c15a41a7-ff32-40f5-a8eb-d01874588ac5","Type":"ContainerStarted","Data":"931b343b63707277753d645fbd21dd5b598ca5a519e098c5aad13ec87e5f64e3"} Jul 06 01:21:14.551675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.551636 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-522fr" event={"ID":"5fc3422c-f065-4485-9b06-13c101fbb3f4","Type":"ContainerStarted","Data":"16d3370a3c693ca074be5dd824b21f17adbfaa50d05f7bdac5b802b9874f1d49"} Jul 06 01:21:14.553430 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.553363 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" event={"ID":"8703fecb-fd27-4224-999b-fb548d74d493","Type":"ContainerStarted","Data":"427370cfe008a5336ebcd176bf8f434abdf1872a476388ba6104a94226e38f97"} Jul 06 01:21:14.555901 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.555777 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" event={"ID":"df104202-ae4e-4716-869d-ac91e7b6c754","Type":"ContainerStarted","Data":"3b16e0366ea0b4c0bcf380ba32203e078f7475d683589761a1af76e6bfb8702c"} Jul 06 01:21:14.555901 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.555857 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" event={"ID":"df104202-ae4e-4716-869d-ac91e7b6c754","Type":"ContainerStarted","Data":"a9fcee012643aab73d4a4cf66f6934c065196c932775dd627c8665634db5abf0"} Jul 06 01:21:14.558361 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.558336 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" event={"ID":"8d5b36d3-986a-4037-9cd1-4830d8145141","Type":"ContainerStarted","Data":"72ccbd2007a144412e1dfa4451a30e043974e7b0763859b8ba6cd4f105387fd4"} Jul 06 01:21:14.559896 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.559846 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" event={"ID":"12a60772-75d1-4849-845e-2640af63efa9","Type":"ContainerStarted","Data":"039139f7bc64435efd788bef33c5b305f30ffc708ef3d956c11fbbfdb580179f"} Jul 06 01:21:14.561631 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.561577 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" event={"ID":"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671","Type":"ContainerStarted","Data":"852b1f905549af4d0fa8eb7648d4e4e150e693dcb332e594465611762bb9922c"} Jul 06 01:21:14.577689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.576032 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" podStartSLOduration=1.576011645 podStartE2EDuration="1.576011645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:14.57551782 +0000 UTC m=+65.998320876" watchObservedRunningTime="2026-07-06 01:21:14.576011645 +0000 UTC m=+65.998814702" Jul 06 01:21:14.801166 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.801077 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:21:14.801166 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.801140 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:21:14.803610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.803584 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 01:21:14.803852 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.803835 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 01:21:14.814356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.814331 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 01:21:14.826800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.826740 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f387a6c0-87c0-406d-a2c4-1e0c5081ad57-metrics-certs\") pod \"network-metrics-daemon-jv4mv\" (UID: \"f387a6c0-87c0-406d-a2c4-1e0c5081ad57\") " pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:21:14.828333 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.828285 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jprt6\" (UniqueName: \"kubernetes.io/projected/2db6b082-87df-4c31-a812-2e38d9c17cdd-kube-api-access-jprt6\") pod \"network-check-target-f7fpk\" (UID: \"2db6b082-87df-4c31-a812-2e38d9c17cdd\") " pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:21:14.835521 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.835454 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:14.838613 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.838374 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:14.902008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.901970 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:21:14.904382 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.904356 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 01:21:14.919987 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:14.919935 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81916daf-c70e-4cf0-afbc-6f9e5806ba00-original-pull-secret\") pod \"global-pull-secret-syncer-pp2g5\" (UID: \"81916daf-c70e-4cf0-afbc-6f9e5806ba00\") " pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:21:15.104663 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.104400 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9bqkt\"" Jul 06 01:21:15.114042 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.113470 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6kdr7\"" Jul 06 01:21:15.114042 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.113800 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jv4mv" Jul 06 01:21:15.114397 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.114346 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp2g5" Jul 06 01:21:15.120290 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.120096 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:21:15.567511 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.567435 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:15.569595 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.569404 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d6c8bb4bf-h6nxl" Jul 06 01:21:15.844139 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:15.844014 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pp2g5"] Jul 06 01:21:16.083739 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.083702 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7fpk"] Jul 06 01:21:16.087146 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.086649 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jv4mv"] Jul 06 01:21:16.572633 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.572592 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" event={"ID":"12a60772-75d1-4849-845e-2640af63efa9","Type":"ContainerStarted","Data":"87883d7916d8edd40d697b48baf266c0e27661ecdc33f42e48962e28a3db762f"} Jul 06 01:21:16.573819 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.573792 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pp2g5" event={"ID":"81916daf-c70e-4cf0-afbc-6f9e5806ba00","Type":"ContainerStarted","Data":"c516a7954a39371207b9eb6efc2eb519011ce764f1df0e1bfa8262235ed88961"} Jul 06 01:21:16.588737 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.588669 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-wwvrf" podStartSLOduration=1.908786885 podStartE2EDuration="3.588654987s" totalImagesPullingTime="1.679868102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:16.588201921 +0000 UTC m=+68.011004975" watchObservedRunningTime="2026-07-06 01:21:16.588654987 +0000 UTC m=+68.011458041" Jul 06 01:21:16.668444 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.668397 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:16.721582 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:16.721463 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:17.499908 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:17.499863 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf387a6c0_87c0_406d_a2c4_1e0c5081ad57.slice/crio-0bdc6c7f5b19793bc6830d0770d9bb7b4518bedda1db5281ea5a13bfe792d6fc WatchSource:0}: Error finding container 0bdc6c7f5b19793bc6830d0770d9bb7b4518bedda1db5281ea5a13bfe792d6fc: Status 404 returned error can't find the container with id 0bdc6c7f5b19793bc6830d0770d9bb7b4518bedda1db5281ea5a13bfe792d6fc Jul 06 01:21:17.579177 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:17.579135 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jv4mv" event={"ID":"f387a6c0-87c0-406d-a2c4-1e0c5081ad57","Type":"ContainerStarted","Data":"0bdc6c7f5b19793bc6830d0770d9bb7b4518bedda1db5281ea5a13bfe792d6fc"} Jul 06 01:21:18.036803 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:18.036768 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db6b082_87df_4c31_a812_2e38d9c17cdd.slice/crio-8ae0a85f375746b06c000f54d09d287fa06be45b77508f01300005eea98a63da WatchSource:0}: Error finding container 8ae0a85f375746b06c000f54d09d287fa06be45b77508f01300005eea98a63da: Status 404 returned error can't find the container with id 8ae0a85f375746b06c000f54d09d287fa06be45b77508f01300005eea98a63da Jul 06 01:21:18.330153 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:18.330053 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:18.381452 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:18.381414 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:18.583932 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:18.583851 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7fpk" event={"ID":"2db6b082-87df-4c31-a812-2e38d9c17cdd","Type":"ContainerStarted","Data":"8ae0a85f375746b06c000f54d09d287fa06be45b77508f01300005eea98a63da"} Jul 06 01:21:18.597419 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:18.597360 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:18.651149 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:18.651116 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:20.183004 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.182653 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:20.283150 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.283069 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:20.368072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.367990 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:20.597156 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.597073 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" event={"ID":"5b431f0d-3a72-41ff-bf8c-f0c89b6ba671","Type":"ContainerStarted","Data":"b407b4363806f46f7400cddbdfc0f6abb631fa6679bb65dfc80edfdda82db7e9"} Jul 06 01:21:20.602498 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.602428 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" event={"ID":"c15a41a7-ff32-40f5-a8eb-d01874588ac5","Type":"ContainerStarted","Data":"077c8235d2e82c737aeb20f46e7c1c5f55f6804846740321b54bb524f4d8ade7"} Jul 06 01:21:20.605662 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.605636 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jv4mv" event={"ID":"f387a6c0-87c0-406d-a2c4-1e0c5081ad57","Type":"ContainerStarted","Data":"525ba3464b3b2acc531cba0b2a83fe6fb6b6c8c22f44f12ef5bcf3a22c476588"} Jul 06 01:21:20.605768 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.605685 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jv4mv" event={"ID":"f387a6c0-87c0-406d-a2c4-1e0c5081ad57","Type":"ContainerStarted","Data":"37edb5a5cb3f66177389ca62d4da361974874066f9e4ab42eccd7e93bf6f033b"} Jul 06 01:21:20.608009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.607975 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-522fr" event={"ID":"5fc3422c-f065-4485-9b06-13c101fbb3f4","Type":"ContainerStarted","Data":"7de7a20d6fbf86c09708d944268e74929b7138d0449ed031cf26085c667de1ee"} Jul 06 01:21:20.608775 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.608755 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:20.613995 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.613935 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b2jwq" podStartSLOduration=1.910100052 podStartE2EDuration="7.613915555s" totalImagesPullingTime="5.703815503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:20.612562291 +0000 UTC m=+72.035365349" watchObservedRunningTime="2026-07-06 01:21:20.613915555 +0000 UTC m=+72.036718648" Jul 06 01:21:20.651966 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.648279 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" event={"ID":"8703fecb-fd27-4224-999b-fb548d74d493","Type":"ContainerStarted","Data":"ada67f861121b47ec50c94aa854fd1f118a9424df9773d9b339b938290a9be0a"} Jul 06 01:21:20.655474 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.655160 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6t92h" podStartSLOduration=2.080766748 podStartE2EDuration="7.655141226s" totalImagesPullingTime="5.574374478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:20.647614743 +0000 UTC m=+72.070417796" watchObservedRunningTime="2026-07-06 01:21:20.655141226 +0000 UTC m=+72.077944271" Jul 06 01:21:20.661116 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.661067 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" event={"ID":"8d5b36d3-986a-4037-9cd1-4830d8145141","Type":"ContainerStarted","Data":"c55b14cf776d573c309a41f328286a8b4cca01af48bce653034cd102f5c107da"} Jul 06 01:21:20.661248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.661148 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" event={"ID":"8d5b36d3-986a-4037-9cd1-4830d8145141","Type":"ContainerStarted","Data":"dc26df40655fa57b70e971b46afe84745af29e5f38e3a7bd7bb1837bdf8afcc7"} Jul 06 01:21:20.670593 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.670109 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-522fr" podStartSLOduration=2.080263626 podStartE2EDuration="7.670090125s" totalImagesPullingTime="5.589826499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:20.668702933 +0000 UTC m=+72.091505989" watchObservedRunningTime="2026-07-06 01:21:20.670090125 +0000 UTC m=+72.092893181" Jul 06 01:21:20.688955 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.688889 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jv4mv" podStartSLOduration=69.458158077 podStartE2EDuration="1m11.688868088s" totalImagesPullingTime="2.230710011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:20.687267977 +0000 UTC m=+72.110071032" watchObservedRunningTime="2026-07-06 01:21:20.688868088 +0000 UTC m=+72.111671144" Jul 06 01:21:20.708368 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.708308 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sk98t" podStartSLOduration=2.107286333 podStartE2EDuration="7.708285559s" totalImagesPullingTime="5.600999226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:20.707440707 +0000 UTC m=+72.130243763" watchObservedRunningTime="2026-07-06 01:21:20.708285559 +0000 UTC m=+72.131088614" Jul 06 01:21:20.726731 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.726428 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-7f6bq" podStartSLOduration=2.103569988 podStartE2EDuration="7.726403602s" totalImagesPullingTime="5.622833614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:20.725624828 +0000 UTC m=+72.148427876" watchObservedRunningTime="2026-07-06 01:21:20.726403602 +0000 UTC m=+72.149206657" Jul 06 01:21:20.807194 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.807096 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:20.842528 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.842311 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-522fr" Jul 06 01:21:20.870595 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.870233 2571 patch_prober.go:28] interesting pod/image-registry-5fd69c4f65-6j2r8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:21:20.870595 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.870298 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" podUID="88699494-8f67-4d0a-bbe8-95758c86285c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:21:20.912363 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.912327 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:20.997968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:20.996039 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rh97s"] Jul 06 01:21:21.003451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.002141 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.005877 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.005135 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxc9g\"" Jul 06 01:21:21.005877 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.005494 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 01:21:21.005877 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.005699 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 01:21:21.029039 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.028940 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rh97s"] Jul 06 01:21:21.037002 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.036969 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:21.060611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.060307 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.060611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.060357 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vpfv\" (UniqueName: \"kubernetes.io/projected/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-api-access-7vpfv\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.060611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.060389 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-crio-socket\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.060611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.060415 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.060611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.060455 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-data-volume\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.137969 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.137777 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.161863 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-crio-socket\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.161911 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.161970 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-data-volume\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.162018 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-crio-socket\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.162054 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.162082 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vpfv\" (UniqueName: \"kubernetes.io/projected/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-api-access-7vpfv\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.162147 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.162208 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:21.662188202 +0000 UTC m=+73.084991239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : secret "insights-runtime-extractor-tls" not found Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.162471 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:21:21.162558 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.162532 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:21.662514873 +0000 UTC m=+73.085317921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : configmap "kube-rbac-proxy" not found Jul 06 01:21:21.163215 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.162631 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-data-volume\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.172255 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.172197 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vpfv\" (UniqueName: \"kubernetes.io/projected/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-api-access-7vpfv\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.215869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.215789 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:21.320548 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.320504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:21.491053 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.491014 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:21.566993 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.566960 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gslcw_e442a372-ef1f-45de-960f-31b7416fd01b/dns/0.log" Jul 06 01:21:21.666127 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.666057 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.666127 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.666109 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:21.666384 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.666269 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:21:21.666384 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.666329 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:22.666310816 +0000 UTC m=+74.089113862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : secret "insights-runtime-extractor-tls" not found Jul 06 01:21:21.666384 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.666373 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:21:21.666543 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:21.666424 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:22.666410278 +0000 UTC m=+74.089213330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : configmap "kube-rbac-proxy" not found Jul 06 01:21:21.767051 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.766926 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gslcw_e442a372-ef1f-45de-960f-31b7416fd01b/kube-rbac-proxy/0.log" Jul 06 01:21:21.897046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.897001 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:21.996212 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:21.996166 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:22.510654 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.510629 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:21:22.512475 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.512375 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:22.593640 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.593606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:22.675008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.674972 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:22.676840 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.676813 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:22.676999 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.676858 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:22.676999 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:22.676970 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:21:22.677105 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:22.676998 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:21:22.677105 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:22.677032 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:24.677014927 +0000 UTC m=+76.099817961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : configmap "kube-rbac-proxy" not found Jul 06 01:21:22.677105 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:22.677051 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:24.677043402 +0000 UTC m=+76.099846440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : secret "insights-runtime-extractor-tls" not found Jul 06 01:21:22.774092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.774005 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:22.912813 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.912764 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:22.966386 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:22.966361 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qjs8x_6d24bbed-1fab-473d-928a-e76a74b4780c/dns-node-resolver/0.log" Jul 06 01:21:23.108910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:23.108808 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:23.293744 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:23.293705 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:23.351108 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:23.351070 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:23.468427 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:23.468376 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:23.567162 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:23.567122 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fd69c4f65-6j2r8_88699494-8f67-4d0a-bbe8-95758c86285c/registry/0.log" Jul 06 01:21:23.646336 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:23.646300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:24.245132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.245100 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:24.366809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.366783 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ncsk8_7cecfe8c-a378-41ca-9656-bceebfd3f60a/node-ca/0.log" Jul 06 01:21:24.568014 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.567901 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6c8bb4bf-h6nxl_df104202-ae4e-4716-869d-ac91e7b6c754/router/0.log" Jul 06 01:21:24.680520 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.680488 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pp2g5" event={"ID":"81916daf-c70e-4cf0-afbc-6f9e5806ba00","Type":"ContainerStarted","Data":"64623da84876bc13a86603fa01fa5cf5080a9d657b16ed66bf30ba85c7d23c27"} Jul 06 01:21:24.681932 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.681908 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7fpk" event={"ID":"2db6b082-87df-4c31-a812-2e38d9c17cdd","Type":"ContainerStarted","Data":"f079d954c48753154ef0bc2ed67e767189a9e84f4703f11b2a984c271c0a35c7"} Jul 06 01:21:24.682061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.681982 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:21:24.687373 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.687338 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:24.695206 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.695179 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:24.695309 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.695266 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:24.695367 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:24.695328 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:21:24.695367 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:24.695336 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:21:24.695446 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:24.695373 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:28.695361653 +0000 UTC m=+80.118164686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : configmap "kube-rbac-proxy" not found Jul 06 01:21:24.695446 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:24.695388 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls podName:4ed4f8bd-8c5c-4c14-ab51-a8479c04508d nodeName:}" failed. No retries permitted until 2026-07-06 01:21:28.695380523 +0000 UTC m=+80.118183555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rh97s" (UID: "4ed4f8bd-8c5c-4c14-ab51-a8479c04508d") : secret "insights-runtime-extractor-tls" not found Jul 06 01:21:24.695783 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.695748 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pp2g5" podStartSLOduration=67.655895701 podStartE2EDuration="1m15.695734857s" totalImagesPullingTime="8.039839156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:24.694547038 +0000 UTC m=+76.117350094" watchObservedRunningTime="2026-07-06 01:21:24.695734857 +0000 UTC m=+76.118537966" Jul 06 01:21:24.708477 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.708436 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f7fpk" podStartSLOduration=69.848132295 podStartE2EDuration="1m15.708423326s" totalImagesPullingTime="5.860291031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:24.707431948 +0000 UTC m=+76.130235007" watchObservedRunningTime="2026-07-06 01:21:24.708423326 +0000 UTC m=+76.131226381" Jul 06 01:21:24.788876 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.788833 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:24.888462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:24.888367 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:25.166329 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:25.166298 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fltxm_4b7146d6-1469-40b2-9631-295badf7e234/serve-healthcheck-canary/0.log" Jul 06 01:21:25.404820 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:25.404772 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:25.464430 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:25.464341 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:25.678859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:25.678827 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:26.926490 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:26.926453 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:27.376480 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:27.376391 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:27.604122 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:27.604081 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:28.728354 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:28.728319 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:28.728819 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:28.728359 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:28.729020 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:28.728998 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:28.730538 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:28.730521 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ed4f8bd-8c5c-4c14-ab51-a8479c04508d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rh97s\" (UID: \"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d\") " pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:28.819989 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:28.819940 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rh97s" Jul 06 01:21:28.951765 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:28.951630 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rh97s"] Jul 06 01:21:28.954356 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:28.954324 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed4f8bd_8c5c_4c14_ab51_a8479c04508d.slice/crio-4ed1f18dda347cae904ee42fb794fd02fcc3afb4b1b7c06c3acc1c2aa722b258 WatchSource:0}: Error finding container 4ed1f18dda347cae904ee42fb794fd02fcc3afb4b1b7c06c3acc1c2aa722b258: Status 404 returned error can't find the container with id 4ed1f18dda347cae904ee42fb794fd02fcc3afb4b1b7c06c3acc1c2aa722b258 Jul 06 01:21:29.527509 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.527447 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:29.703783 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.703748 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rh97s" event={"ID":"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d","Type":"ContainerStarted","Data":"4ed1f18dda347cae904ee42fb794fd02fcc3afb4b1b7c06c3acc1c2aa722b258"} Jul 06 01:21:29.753030 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.752935 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:29.807082 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.806987 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mnnhh"] Jul 06 01:21:29.813619 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.813593 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.817159 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.817136 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q8hgd\"" Jul 06 01:21:29.817440 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.817418 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 01:21:29.817675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.817657 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 01:21:29.817849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.817833 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 01:21:29.818285 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.818036 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 01:21:29.852792 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.852675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:29.931666 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.931598 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:29.938495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938464 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-metrics-client-ca\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938518 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-sys\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-root\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938563 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-wtmp\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938587 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938621 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-tls\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938655 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-accelerators-collector-config\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938990 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938693 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-textfile\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:29.938990 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:29.938727 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbjwt\" (UniqueName: \"kubernetes.io/projected/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-kube-api-access-sbjwt\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.028172 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.028110 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039717 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-tls\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039755 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-accelerators-collector-config\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-textfile\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039827 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbjwt\" (UniqueName: \"kubernetes.io/projected/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-kube-api-access-sbjwt\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039883 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-metrics-client-ca\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039928 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-sys\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.039973 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-root\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.040002 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-wtmp\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.040572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.040155 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-wtmp\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.041386 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:30.040786 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 01:21:30.041386 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:30.040874 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-tls podName:fc9ea35c-d37e-4494-b4b8-8dc1e43bda53 nodeName:}" failed. No retries permitted until 2026-07-06 01:21:30.54085352 +0000 UTC m=+81.963656569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-tls") pod "node-exporter-mnnhh" (UID: "fc9ea35c-d37e-4494-b4b8-8dc1e43bda53") : secret "node-exporter-tls" not found Jul 06 01:21:30.041386 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.040894 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-sys\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.041807 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.041760 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-accelerators-collector-config\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.041925 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.041901 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-textfile\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.042086 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.042063 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-root\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.042156 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.042112 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-metrics-client-ca\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.043129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.043088 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.048365 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.048343 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbjwt\" (UniqueName: \"kubernetes.io/projected/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-kube-api-access-sbjwt\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.128830 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.128747 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.226726 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.226684 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.287630 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.287595 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.530009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.529971 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.546789 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.544057 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-tls\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.548419 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.548392 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9ea35c-d37e-4494-b4b8-8dc1e43bda53-node-exporter-tls\") pod \"node-exporter-mnnhh\" (UID: \"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53\") " pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.625486 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.625453 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.729492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.729458 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mnnhh" Jul 06 01:21:30.759295 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.759259 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:30.844028 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:30.843935 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:31.161055 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:31.160912 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:32.365635 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:32.365582 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:32.465705 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:32.465668 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:32.682180 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:32.682138 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:32.785799 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:32.785760 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:32.882663 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:32.882593 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:32.891509 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:32.891483 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9ea35c_d37e_4494_b4b8_8dc1e43bda53.slice/crio-0c86b5681b2eb1961dedd4a6cd3dbfa182a2c717fe95bc9271a965c6d700c086 WatchSource:0}: Error finding container 0c86b5681b2eb1961dedd4a6cd3dbfa182a2c717fe95bc9271a965c6d700c086: Status 404 returned error can't find the container with id 0c86b5681b2eb1961dedd4a6cd3dbfa182a2c717fe95bc9271a965c6d700c086 Jul 06 01:21:32.982916 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:32.982884 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:33.082482 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:33.082449 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:33.593780 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:33.593725 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:33.694023 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:33.693988 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:33.722917 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:33.722875 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rh97s" event={"ID":"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d","Type":"ContainerStarted","Data":"c3248ebfee1fd95c4f8c8a8c6243a444632a59fd341c576e919ae2071efa22e8"} Jul 06 01:21:33.724229 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:33.724203 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnnhh" event={"ID":"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53","Type":"ContainerStarted","Data":"0c86b5681b2eb1961dedd4a6cd3dbfa182a2c717fe95bc9271a965c6d700c086"} Jul 06 01:21:34.554724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.554613 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:34.567433 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.567395 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg"] Jul 06 01:21:34.570957 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.570925 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:34.573514 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.573487 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 01:21:34.573637 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.573493 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sl889\"" Jul 06 01:21:34.579170 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.578877 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg"] Jul 06 01:21:34.616622 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.616589 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:34.678778 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.678739 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94e957d-a08d-49e1-bcb5-217e8041dd29-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:34.678987 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.678806 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4ss\" (UniqueName: \"kubernetes.io/projected/f94e957d-a08d-49e1-bcb5-217e8041dd29-kube-api-access-rd4ss\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:34.730883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.730847 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rh97s" event={"ID":"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d","Type":"ContainerStarted","Data":"7ddec177363cd238e1131f1e90c89cbc7eff3893e6dd46e6ff55d407fd7b51d4"} Jul 06 01:21:34.736792 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.736028 2571 generic.go:356] "Generic (PLEG): container finished" podID="fc9ea35c-d37e-4494-b4b8-8dc1e43bda53" containerID="cd2101271d8f33f58156841b33ad9d9fa3a145d4787cecc46c271fbdf1410d7c" exitCode=0 Jul 06 01:21:34.736792 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.736131 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnnhh" event={"ID":"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53","Type":"ContainerDied","Data":"cd2101271d8f33f58156841b33ad9d9fa3a145d4787cecc46c271fbdf1410d7c"} Jul 06 01:21:34.779716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.779671 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94e957d-a08d-49e1-bcb5-217e8041dd29-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:34.779845 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.779750 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4ss\" (UniqueName: \"kubernetes.io/projected/f94e957d-a08d-49e1-bcb5-217e8041dd29-kube-api-access-rd4ss\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:34.779845 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:34.779832 2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 01:21:34.780000 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:21:34.779919 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94e957d-a08d-49e1-bcb5-217e8041dd29-monitoring-plugin-cert podName:f94e957d-a08d-49e1-bcb5-217e8041dd29 nodeName:}" failed. No retries permitted until 2026-07-06 01:21:35.279896775 +0000 UTC m=+86.702699811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f94e957d-a08d-49e1-bcb5-217e8041dd29-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-jqhcg" (UID: "f94e957d-a08d-49e1-bcb5-217e8041dd29") : secret "monitoring-plugin-cert" not found Jul 06 01:21:34.791903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:34.791871 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4ss\" (UniqueName: \"kubernetes.io/projected/f94e957d-a08d-49e1-bcb5-217e8041dd29-kube-api-access-rd4ss\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:35.008361 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.008323 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:35.283722 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.283688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94e957d-a08d-49e1-bcb5-217e8041dd29-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:35.286468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.286438 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94e957d-a08d-49e1-bcb5-217e8041dd29-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jqhcg\" (UID: \"f94e957d-a08d-49e1-bcb5-217e8041dd29\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:35.482067 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.482031 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:35.743189 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.743154 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnnhh" event={"ID":"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53","Type":"ContainerStarted","Data":"aa214f070ea27614e7cb064967a679be1e607a7ac346eb6d63aa24cace81b212"} Jul 06 01:21:35.743621 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.743206 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnnhh" event={"ID":"fc9ea35c-d37e-4494-b4b8-8dc1e43bda53","Type":"ContainerStarted","Data":"567d6f012bfa72b28818c1596065978b0c00c07d2425efbb085fa1758e82a27a"} Jul 06 01:21:35.763013 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:35.762917 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mnnhh" podStartSLOduration=5.856190423 podStartE2EDuration="6.762894893s" totalImagesPullingTime="842.812625ms" totalInitContainerRuntime="63.891845ms" isStatefulPod=true podCreationTimestamp="2026-07-06 01:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:35.760919121 +0000 UTC m=+87.183722198" watchObservedRunningTime="2026-07-06 01:21:35.762894893 +0000 UTC m=+87.185697951" Jul 06 01:21:36.057645 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.057559 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:36.080459 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.080423 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd69c4f65-6j2r8"] Jul 06 01:21:36.226567 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.226527 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:36.327117 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.327037 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:36.411880 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.411857 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg"] Jul 06 01:21:36.414973 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:36.414936 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94e957d_a08d_49e1_bcb5_217e8041dd29.slice/crio-39cb19c18361a55f7c83781280bbc258922adc07d1c9e984dc9cfbe93593134a WatchSource:0}: Error finding container 39cb19c18361a55f7c83781280bbc258922adc07d1c9e984dc9cfbe93593134a: Status 404 returned error can't find the container with id 39cb19c18361a55f7c83781280bbc258922adc07d1c9e984dc9cfbe93593134a Jul 06 01:21:36.747759 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.747715 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" event={"ID":"f94e957d-a08d-49e1-bcb5-217e8041dd29","Type":"ContainerStarted","Data":"39cb19c18361a55f7c83781280bbc258922adc07d1c9e984dc9cfbe93593134a"} Jul 06 01:21:36.749788 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.749749 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rh97s" event={"ID":"4ed4f8bd-8c5c-4c14-ab51-a8479c04508d","Type":"ContainerStarted","Data":"d1715ac46a6080e8f373455e784e84b57d631287363990c95d26ed030c396d63"} Jul 06 01:21:36.766732 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:36.766685 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rh97s" podStartSLOduration=9.513373349 podStartE2EDuration="16.766668361s" totalImagesPullingTime="7.253295012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:21:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:36.765587742 +0000 UTC m=+88.188390809" watchObservedRunningTime="2026-07-06 01:21:36.766668361 +0000 UTC m=+88.189471415" Jul 06 01:21:37.325276 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:37.325224 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:38.759285 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:38.759248 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" event={"ID":"f94e957d-a08d-49e1-bcb5-217e8041dd29","Type":"ContainerStarted","Data":"95f8793d8c9509feb141ef4c631b5a39829afa1caaa697d4105e4fc6b1ef884a"} Jul 06 01:21:38.759704 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:38.759426 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:38.764168 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:38.764149 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" Jul 06 01:21:38.777984 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:38.776115 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jqhcg" podStartSLOduration=3.498739831 podStartE2EDuration="4.776090628s" totalImagesPullingTime="1.277350797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:38.773334904 +0000 UTC m=+90.196137985" watchObservedRunningTime="2026-07-06 01:21:38.776090628 +0000 UTC m=+90.198893684" Jul 06 01:21:40.124248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.124212 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-877b9454b-qwdfn"] Jul 06 01:21:40.127415 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.127398 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.129933 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.129909 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 01:21:40.131061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131037 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vjkln\"" Jul 06 01:21:40.131061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131048 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 01:21:40.131219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131091 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 01:21:40.131219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131041 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 01:21:40.131219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131095 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 01:21:40.131219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131095 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 01:21:40.131483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.131468 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 01:21:40.135039 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.135022 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 01:21:40.139302 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.139282 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-877b9454b-qwdfn"] Jul 06 01:21:40.224645 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224611 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-serving-cert\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.224645 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224650 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-config\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.224865 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224680 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-trusted-ca-bundle\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.224865 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224701 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-oauth-serving-cert\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.224865 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224778 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-service-ca\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.224865 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224809 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqc4t\" (UniqueName: \"kubernetes.io/projected/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-kube-api-access-jqc4t\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.224865 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.224843 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-oauth-config\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326146 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326107 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-service-ca\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326146 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326145 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqc4t\" (UniqueName: \"kubernetes.io/projected/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-kube-api-access-jqc4t\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326171 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-oauth-config\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326209 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-serving-cert\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326224 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-config\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326244 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-trusted-ca-bundle\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326258 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-oauth-serving-cert\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.326901 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.326877 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-service-ca\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.327035 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.327004 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-oauth-serving-cert\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.327097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.327068 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-config\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.327168 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.327150 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-trusted-ca-bundle\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.328645 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.328616 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-oauth-config\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.328807 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.328788 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-serving-cert\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.334264 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.334242 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqc4t\" (UniqueName: \"kubernetes.io/projected/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-kube-api-access-jqc4t\") pod \"console-877b9454b-qwdfn\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.437360 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.437323 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:40.569531 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.569475 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-877b9454b-qwdfn"] Jul 06 01:21:40.571789 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:21:40.571761 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7a8fd0_4ae6_465f_8dda_3e015da2722d.slice/crio-861359f370393448b746e39a8f2f3df55752313af3e4c473f76ac2277398e0fc WatchSource:0}: Error finding container 861359f370393448b746e39a8f2f3df55752313af3e4c473f76ac2277398e0fc: Status 404 returned error can't find the container with id 861359f370393448b746e39a8f2f3df55752313af3e4c473f76ac2277398e0fc Jul 06 01:21:40.767107 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:40.767015 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-877b9454b-qwdfn" event={"ID":"4f7a8fd0-4ae6-465f-8dda-3e015da2722d","Type":"ContainerStarted","Data":"861359f370393448b746e39a8f2f3df55752313af3e4c473f76ac2277398e0fc"} Jul 06 01:21:41.604100 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:41.604042 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:41.704697 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:41.704661 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:41.760611 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:41.760574 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:43.781174 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:43.781126 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-877b9454b-qwdfn" event={"ID":"4f7a8fd0-4ae6-465f-8dda-3e015da2722d","Type":"ContainerStarted","Data":"9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd"} Jul 06 01:21:43.797994 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:43.797918 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-877b9454b-qwdfn" podStartSLOduration=1.122388818 podStartE2EDuration="3.797903452s" totalImagesPullingTime="2.675514634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:21:43.796403744 +0000 UTC m=+95.219206799" watchObservedRunningTime="2026-07-06 01:21:43.797903452 +0000 UTC m=+95.220706553" Jul 06 01:21:45.115686 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:45.115645 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:45.216869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:45.216826 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:48.592136 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:48.592091 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:48.647333 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:48.647300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:49.332191 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:49.332155 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:49.394309 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:49.394264 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:50.438374 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:50.438335 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:50.438758 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:50.438398 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:50.443214 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:50.443192 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:50.811188 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:50.811103 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:21:51.928708 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:51.928677 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:52.029620 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:52.029584 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:53.330849 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:53.330810 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:53.388539 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:53.388504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:55.687469 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:55.687443 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f7fpk" Jul 06 01:21:56.531449 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:56.531404 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:56.582451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:56.582419 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:57.008252 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:57.008209 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:57.106334 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:57.106301 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:21:57.158202 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:21:57.158168 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:01.104668 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.104624 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" podUID="88699494-8f67-4d0a-bbe8-95758c86285c" containerName="registry" containerID="cri-o://6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded" gracePeriod=30 Jul 06 01:22:01.350888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.350865 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:22:01.406975 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.406878 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88699494-8f67-4d0a-bbe8-95758c86285c-ca-trust-extracted\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.406975 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.406915 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4p8c\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-kube-api-access-w4p8c\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.406977 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-image-registry-private-configuration\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407003 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-trusted-ca\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407036 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-registry-certificates\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407122 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-bound-sa-token\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407159 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-installation-pull-secrets\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407185 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") pod \"88699494-8f67-4d0a-bbe8-95758c86285c\" (UID: \"88699494-8f67-4d0a-bbe8-95758c86285c\") " Jul 06 01:22:01.407513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407491 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:22:01.407631 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.407467 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:22:01.409762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.409729 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:22:01.409762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.409765 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-kube-api-access-w4p8c" (OuterVolumeSpecName: "kube-api-access-w4p8c") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "kube-api-access-w4p8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:22:01.409968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.409793 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:22:01.409968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.409826 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:22:01.410046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.409985 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:22:01.417467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.417442 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88699494-8f67-4d0a-bbe8-95758c86285c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "88699494-8f67-4d0a-bbe8-95758c86285c" (UID: "88699494-8f67-4d0a-bbe8-95758c86285c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:22:01.508510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508474 2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-registry-certificates\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508507 2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-bound-sa-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508518 2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-installation-pull-secrets\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508731 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508527 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508731 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508536 2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88699494-8f67-4d0a-bbe8-95758c86285c-ca-trust-extracted\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508731 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508545 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4p8c\" (UniqueName: \"kubernetes.io/projected/88699494-8f67-4d0a-bbe8-95758c86285c-kube-api-access-w4p8c\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508731 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508556 2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88699494-8f67-4d0a-bbe8-95758c86285c-image-registry-private-configuration\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.508731 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.508566 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88699494-8f67-4d0a-bbe8-95758c86285c-trusted-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:22:01.851157 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.851113 2571 generic.go:356] "Generic (PLEG): container finished" podID="88699494-8f67-4d0a-bbe8-95758c86285c" containerID="6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded" exitCode=0 Jul 06 01:22:01.851358 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.851187 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" Jul 06 01:22:01.851358 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.851198 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" event={"ID":"88699494-8f67-4d0a-bbe8-95758c86285c","Type":"ContainerDied","Data":"6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded"} Jul 06 01:22:01.851358 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.851287 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69c4f65-6j2r8" event={"ID":"88699494-8f67-4d0a-bbe8-95758c86285c","Type":"ContainerDied","Data":"33ada79f7f86d6c0ef61791f2ff8b89d7b3c5877d59ba3f3d26415fd1bc8d18c"} Jul 06 01:22:01.851358 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.851316 2571 scope.go:117] "RemoveContainer" containerID="6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded" Jul 06 01:22:01.859812 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.859788 2571 scope.go:117] "RemoveContainer" containerID="6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded" Jul 06 01:22:01.860169 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:22:01.860139 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded\": container with ID starting with 6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded not found: ID does not exist" containerID="6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded" Jul 06 01:22:01.860230 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.860181 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded"} err="failed to get container status \"6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded\": rpc error: code = NotFound desc = could not find container \"6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded\": container with ID starting with 6b796f2aad9c90cad7c1c0a72fce3cf089a8226052fb3b749b1357ee47588ded not found: ID does not exist" Jul 06 01:22:01.871342 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.871310 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd69c4f65-6j2r8"] Jul 06 01:22:01.873450 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:01.873428 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fd69c4f65-6j2r8"] Jul 06 01:22:03.270235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:03.270203 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88699494-8f67-4d0a-bbe8-95758c86285c" path="/var/lib/kubelet/pods/88699494-8f67-4d0a-bbe8-95758c86285c/volumes" Jul 06 01:22:03.590194 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:03.590115 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:03.646536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:03.646495 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:05.812085 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:05.812054 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:10.777651 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:10.777612 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:10.879151 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:10.879112 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:10.978836 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:10.978803 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:49.059299 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:49.059262 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:49.259193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:49.259159 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:51.088212 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:51.088171 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:51.198586 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:51.198555 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:54.164245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.164211 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-744d46645f-c9sx5"] Jul 06 01:22:54.164629 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.164481 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88699494-8f67-4d0a-bbe8-95758c86285c" containerName="registry" Jul 06 01:22:54.164629 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.164496 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="88699494-8f67-4d0a-bbe8-95758c86285c" containerName="registry" Jul 06 01:22:54.164629 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.164544 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="88699494-8f67-4d0a-bbe8-95758c86285c" containerName="registry" Jul 06 01:22:54.168607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.168589 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.171032 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.170961 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 01:22:54.171134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.171064 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g6fsc\"" Jul 06 01:22:54.171134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.171101 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 01:22:54.171250 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.171127 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 01:22:54.171335 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.171308 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 01:22:54.171432 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.171408 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 01:22:54.175831 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.175811 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 01:22:54.179468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.179437 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-744d46645f-c9sx5"] Jul 06 01:22:54.317356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjnw\" (UniqueName: \"kubernetes.io/projected/e16a91f4-66ef-4051-85c8-6561dc5f7447-kube-api-access-9kjnw\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317356 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-secret-telemeter-client\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317435 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-federate-client-tls\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317477 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-telemeter-trusted-ca-bundle\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317544 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-metrics-client-ca\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317665 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317578 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-serving-certs-ca-bundle\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317665 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317596 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-telemeter-client-tls\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.317665 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.317631 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.418983 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.418888 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-federate-client-tls\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.418983 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.418928 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-telemeter-trusted-ca-bundle\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419029 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-metrics-client-ca\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419062 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-serving-certs-ca-bundle\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419089 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-telemeter-client-tls\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419120 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419154 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjnw\" (UniqueName: \"kubernetes.io/projected/e16a91f4-66ef-4051-85c8-6561dc5f7447-kube-api-access-9kjnw\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419181 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-secret-telemeter-client\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.419963 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419914 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-metrics-client-ca\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.420085 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.419973 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-telemeter-trusted-ca-bundle\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.420085 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.420047 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16a91f4-66ef-4051-85c8-6561dc5f7447-serving-certs-ca-bundle\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.421555 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.421536 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-telemeter-client-tls\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.421635 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.421568 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-federate-client-tls\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.421862 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.421843 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.421933 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.421917 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e16a91f4-66ef-4051-85c8-6561dc5f7447-secret-telemeter-client\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.426090 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.426069 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjnw\" (UniqueName: \"kubernetes.io/projected/e16a91f4-66ef-4051-85c8-6561dc5f7447-kube-api-access-9kjnw\") pod \"telemeter-client-744d46645f-c9sx5\" (UID: \"e16a91f4-66ef-4051-85c8-6561dc5f7447\") " pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.479827 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.479800 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" Jul 06 01:22:54.629381 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:54.629354 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-744d46645f-c9sx5"] Jul 06 01:22:54.631691 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:22:54.631663 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16a91f4_66ef_4051_85c8_6561dc5f7447.slice/crio-b9a121a9ab3f9991bbda6f9ef7e635376995b1bfdeae3204065ad303989aa9c0 WatchSource:0}: Error finding container b9a121a9ab3f9991bbda6f9ef7e635376995b1bfdeae3204065ad303989aa9c0: Status 404 returned error can't find the container with id b9a121a9ab3f9991bbda6f9ef7e635376995b1bfdeae3204065ad303989aa9c0 Jul 06 01:22:55.039383 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:55.039349 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" event={"ID":"e16a91f4-66ef-4051-85c8-6561dc5f7447","Type":"ContainerStarted","Data":"b9a121a9ab3f9991bbda6f9ef7e635376995b1bfdeae3204065ad303989aa9c0"} Jul 06 01:22:57.047529 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:57.047493 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" event={"ID":"e16a91f4-66ef-4051-85c8-6561dc5f7447","Type":"ContainerStarted","Data":"0e5783ad5bb45d66d17f7850265e1cf32d20c6f9675094b7564df1f192f45f2e"} Jul 06 01:22:58.052617 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.052580 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" event={"ID":"e16a91f4-66ef-4051-85c8-6561dc5f7447","Type":"ContainerStarted","Data":"838c38cef73e15ced1e9274465d9e2d3d37dad9d830ea529ab7afa19562b5495"} Jul 06 01:22:58.053026 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.052646 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" event={"ID":"e16a91f4-66ef-4051-85c8-6561dc5f7447","Type":"ContainerStarted","Data":"3c2fc1e945a3bb4941b78aca3a575b8667b41a147b3e09c1862d52bab2578e9e"} Jul 06 01:22:58.073920 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.073869 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-744d46645f-c9sx5" podStartSLOduration=1.177895161 podStartE2EDuration="4.073852407s" totalImagesPullingTime="2.895957246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:22:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:22:58.072623295 +0000 UTC m=+169.495426375" watchObservedRunningTime="2026-07-06 01:22:58.073852407 +0000 UTC m=+169.496655462" Jul 06 01:22:58.770159 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.770125 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6559bf84-ks5k6"] Jul 06 01:22:58.773349 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.773324 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.782500 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.782474 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6559bf84-ks5k6"] Jul 06 01:22:58.824421 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.824386 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:58.877516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.877475 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:58.956184 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956152 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-oauth-config\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.956184 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956188 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-oauth-serving-cert\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.956380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-service-ca\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.956380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956238 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-trusted-ca-bundle\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.956380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956298 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-serving-cert\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.956380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956326 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-console-config\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.956380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.956356 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrsz\" (UniqueName: \"kubernetes.io/projected/083f7be5-78a2-439b-99b9-309d2b5158cc-kube-api-access-nlrsz\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:58.974887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:58.974841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:59.037412 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.037320 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:59.056769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056744 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-console-config\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056782 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrsz\" (UniqueName: \"kubernetes.io/projected/083f7be5-78a2-439b-99b9-309d2b5158cc-kube-api-access-nlrsz\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056807 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-oauth-config\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056828 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-oauth-serving-cert\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056847 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-service-ca\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056864 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-trusted-ca-bundle\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.056890 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-serving-cert\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057538 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.057517 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-console-config\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057680 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.057653 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-service-ca\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057778 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.057761 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-trusted-ca-bundle\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.057861 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.057843 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-oauth-serving-cert\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.059794 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.059773 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-serving-cert\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.059906 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.059885 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-oauth-config\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.064604 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.064586 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrsz\" (UniqueName: \"kubernetes.io/projected/083f7be5-78a2-439b-99b9-309d2b5158cc-kube-api-access-nlrsz\") pod \"console-7b6559bf84-ks5k6\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.084158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.084139 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:22:59.215549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.215524 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6559bf84-ks5k6"] Jul 06 01:22:59.217859 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:22:59.217820 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083f7be5_78a2_439b_99b9_309d2b5158cc.slice/crio-fb40ca722cfde3033b018bd3c71ea7e8d5732bf1fca7da4925a8d438892bf66f WatchSource:0}: Error finding container fb40ca722cfde3033b018bd3c71ea7e8d5732bf1fca7da4925a8d438892bf66f: Status 404 returned error can't find the container with id fb40ca722cfde3033b018bd3c71ea7e8d5732bf1fca7da4925a8d438892bf66f Jul 06 01:22:59.573892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:22:59.573841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:23:00.061226 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:00.061188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6559bf84-ks5k6" event={"ID":"083f7be5-78a2-439b-99b9-309d2b5158cc","Type":"ContainerStarted","Data":"ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470"} Jul 06 01:23:00.061678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:00.061246 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6559bf84-ks5k6" event={"ID":"083f7be5-78a2-439b-99b9-309d2b5158cc","Type":"ContainerStarted","Data":"fb40ca722cfde3033b018bd3c71ea7e8d5732bf1fca7da4925a8d438892bf66f"} Jul 06 01:23:00.077513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:00.077460 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6559bf84-ks5k6" podStartSLOduration=2.077444797 podStartE2EDuration="2.077444797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:22:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:23:00.076540028 +0000 UTC m=+171.499343100" watchObservedRunningTime="2026-07-06 01:23:00.077444797 +0000 UTC m=+171.500247849" Jul 06 01:23:09.085165 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.085060 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:23:09.085165 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.085153 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:23:09.089723 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.089698 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:23:09.097301 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.097279 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:23:09.146721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.146687 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-877b9454b-qwdfn"] Jul 06 01:23:09.242722 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.242687 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:23:09.350514 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.350426 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:23:09.407200 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:09.407170 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:23:34.173965 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.173880 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-877b9454b-qwdfn" podUID="4f7a8fd0-4ae6-465f-8dda-3e015da2722d" containerName="console" containerID="cri-o://9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd" gracePeriod=15 Jul 06 01:23:34.415249 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.415225 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:23:34.548301 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548201 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-config\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548301 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548254 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqc4t\" (UniqueName: \"kubernetes.io/projected/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-kube-api-access-jqc4t\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548301 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548287 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-trusted-ca-bundle\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548576 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548328 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-serving-cert\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548576 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548354 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-service-ca\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548576 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548398 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-oauth-config\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548576 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548436 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-oauth-serving-cert\") pod \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\" (UID: \"4f7a8fd0-4ae6-465f-8dda-3e015da2722d\") " Jul 06 01:23:34.548800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548766 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-config" (OuterVolumeSpecName: "console-config") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:23:34.548933 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548899 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:23:34.549078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.548929 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:23:34.549078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.549015 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:23:34.550622 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.550597 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:23:34.550717 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.550675 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-kube-api-access-jqc4t" (OuterVolumeSpecName: "kube-api-access-jqc4t") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "kube-api-access-jqc4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:23:34.550762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.550723 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f7a8fd0-4ae6-465f-8dda-3e015da2722d" (UID: "4f7a8fd0-4ae6-465f-8dda-3e015da2722d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:23:34.649395 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649355 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqc4t\" (UniqueName: \"kubernetes.io/projected/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-kube-api-access-jqc4t\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:34.649395 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649388 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:34.649395 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649397 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:34.649628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649407 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:34.649628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649416 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:34.649628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649424 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:34.649628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:34.649432 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f7a8fd0-4ae6-465f-8dda-3e015da2722d-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:23:35.187072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.187024 2571 generic.go:356] "Generic (PLEG): container finished" podID="4f7a8fd0-4ae6-465f-8dda-3e015da2722d" containerID="9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd" exitCode=0 Jul 06 01:23:35.187072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.187081 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-877b9454b-qwdfn" Jul 06 01:23:35.187568 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.187109 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-877b9454b-qwdfn" event={"ID":"4f7a8fd0-4ae6-465f-8dda-3e015da2722d","Type":"ContainerDied","Data":"9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd"} Jul 06 01:23:35.187568 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.187188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-877b9454b-qwdfn" event={"ID":"4f7a8fd0-4ae6-465f-8dda-3e015da2722d","Type":"ContainerDied","Data":"861359f370393448b746e39a8f2f3df55752313af3e4c473f76ac2277398e0fc"} Jul 06 01:23:35.187568 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.187209 2571 scope.go:117] "RemoveContainer" containerID="9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd" Jul 06 01:23:35.196620 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.196600 2571 scope.go:117] "RemoveContainer" containerID="9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd" Jul 06 01:23:35.197144 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:23:35.197118 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd\": container with ID starting with 9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd not found: ID does not exist" containerID="9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd" Jul 06 01:23:35.197219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.197155 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd"} err="failed to get container status \"9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd\": rpc error: code = NotFound desc = could not find container \"9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd\": container with ID starting with 9813e75f6a5e0069d59dcd7ac76a17bfa9847efab4bf679c25025178edc1bbcd not found: ID does not exist" Jul 06 01:23:35.209633 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.209608 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-877b9454b-qwdfn"] Jul 06 01:23:35.213099 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.213081 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-877b9454b-qwdfn"] Jul 06 01:23:35.270281 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:23:35.270254 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f7a8fd0-4ae6-465f-8dda-3e015da2722d" path="/var/lib/kubelet/pods/4f7a8fd0-4ae6-465f-8dda-3e015da2722d/volumes" Jul 06 01:24:04.315831 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:04.315777 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:04.365634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:04.365594 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:12.516567 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:12.516524 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:16.218147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:16.218113 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:16.318829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:16.318767 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:21.223085 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.223054 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f658d5cc7-stb5z"] Jul 06 01:24:21.223464 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.223317 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7a8fd0-4ae6-465f-8dda-3e015da2722d" containerName="console" Jul 06 01:24:21.223464 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.223328 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7a8fd0-4ae6-465f-8dda-3e015da2722d" containerName="console" Jul 06 01:24:21.223464 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.223381 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f7a8fd0-4ae6-465f-8dda-3e015da2722d" containerName="console" Jul 06 01:24:21.227548 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.227523 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.238701 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.238676 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f658d5cc7-stb5z"] Jul 06 01:24:21.273735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.273707 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:21.301768 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.301740 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-oauth-serving-cert\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.301892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.301794 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-service-ca\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.301892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.301837 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-config\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.301892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.301871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-serving-cert\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.302094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.301925 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-trusted-ca-bundle\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.302181 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.302153 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgln\" (UniqueName: \"kubernetes.io/projected/1201ab3d-528e-4620-91ca-f47e5b2879dd-kube-api-access-gpgln\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.302366 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.302343 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-oauth-config\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.329092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.329066 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:21.403433 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403397 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-config\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.403574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403440 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-serving-cert\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.403574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403557 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-trusted-ca-bundle\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.403665 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403612 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgln\" (UniqueName: \"kubernetes.io/projected/1201ab3d-528e-4620-91ca-f47e5b2879dd-kube-api-access-gpgln\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.403724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403670 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-oauth-config\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.403724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403715 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-oauth-serving-cert\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.403814 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.403752 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-service-ca\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.404285 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.404254 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-config\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.404399 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.404363 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-trusted-ca-bundle\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.404399 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.404382 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-service-ca\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.404518 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.404489 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-oauth-serving-cert\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.405960 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.405925 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-serving-cert\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.406040 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.406014 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-oauth-config\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.411044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.411023 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgln\" (UniqueName: \"kubernetes.io/projected/1201ab3d-528e-4620-91ca-f47e5b2879dd-kube-api-access-gpgln\") pod \"console-f658d5cc7-stb5z\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.537757 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.537682 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:21.665566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:21.665539 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f658d5cc7-stb5z"] Jul 06 01:24:21.667721 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:24:21.667684 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1201ab3d_528e_4620_91ca_f47e5b2879dd.slice/crio-3edd8c8d12114c91704e8ab0d4997f593a17d30d0277025d5817d97340b35072 WatchSource:0}: Error finding container 3edd8c8d12114c91704e8ab0d4997f593a17d30d0277025d5817d97340b35072: Status 404 returned error can't find the container with id 3edd8c8d12114c91704e8ab0d4997f593a17d30d0277025d5817d97340b35072 Jul 06 01:24:22.354149 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:22.354113 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f658d5cc7-stb5z" event={"ID":"1201ab3d-528e-4620-91ca-f47e5b2879dd","Type":"ContainerStarted","Data":"6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb"} Jul 06 01:24:22.354542 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:22.354162 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f658d5cc7-stb5z" event={"ID":"1201ab3d-528e-4620-91ca-f47e5b2879dd","Type":"ContainerStarted","Data":"3edd8c8d12114c91704e8ab0d4997f593a17d30d0277025d5817d97340b35072"} Jul 06 01:24:22.373463 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:22.373413 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f658d5cc7-stb5z" podStartSLOduration=1.373396363 podStartE2EDuration="1.373396363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:24:22.370245485 +0000 UTC m=+253.793048556" watchObservedRunningTime="2026-07-06 01:24:22.373396363 +0000 UTC m=+253.796199418" Jul 06 01:24:22.519907 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:22.519865 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:22.620817 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:22.620702 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:31.537893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:31.537816 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:31.537893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:31.537875 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:31.542500 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:31.542480 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:32.392808 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:32.392781 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:24:32.437344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:32.437304 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6559bf84-ks5k6"] Jul 06 01:24:32.589545 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:32.589511 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:32.711382 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:32.711342 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:24:57.461201 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.461139 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b6559bf84-ks5k6" podUID="083f7be5-78a2-439b-99b9-309d2b5158cc" containerName="console" containerID="cri-o://ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470" gracePeriod=15 Jul 06 01:24:57.702517 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.702494 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:24:57.789323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789234 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlrsz\" (UniqueName: \"kubernetes.io/projected/083f7be5-78a2-439b-99b9-309d2b5158cc-kube-api-access-nlrsz\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789290 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-oauth-serving-cert\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789315 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-oauth-config\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789344 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-service-ca\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789366 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-serving-cert\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789386 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-console-config\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789444 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-trusted-ca-bundle\") pod \"083f7be5-78a2-439b-99b9-309d2b5158cc\" (UID: \"083f7be5-78a2-439b-99b9-309d2b5158cc\") " Jul 06 01:24:57.789864 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789835 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:24:57.789934 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789897 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:24:57.790021 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.789999 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-console-config" (OuterVolumeSpecName: "console-config") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:24:57.790076 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.790050 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:24:57.791488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.791456 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:24:57.791824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.791810 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083f7be5-78a2-439b-99b9-309d2b5158cc-kube-api-access-nlrsz" (OuterVolumeSpecName: "kube-api-access-nlrsz") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "kube-api-access-nlrsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:24:57.791871 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.791826 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "083f7be5-78a2-439b-99b9-309d2b5158cc" (UID: "083f7be5-78a2-439b-99b9-309d2b5158cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:24:57.890494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890445 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:57.890494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890489 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlrsz\" (UniqueName: \"kubernetes.io/projected/083f7be5-78a2-439b-99b9-309d2b5158cc-kube-api-access-nlrsz\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:57.890494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890499 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:57.890494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890508 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:57.890743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890519 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:57.890743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890527 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/083f7be5-78a2-439b-99b9-309d2b5158cc-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:57.890743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:57.890537 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/083f7be5-78a2-439b-99b9-309d2b5158cc-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:24:58.480438 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.480402 2571 generic.go:356] "Generic (PLEG): container finished" podID="083f7be5-78a2-439b-99b9-309d2b5158cc" containerID="ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470" exitCode=0 Jul 06 01:24:58.480893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.480443 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6559bf84-ks5k6" Jul 06 01:24:58.480893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.480488 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6559bf84-ks5k6" event={"ID":"083f7be5-78a2-439b-99b9-309d2b5158cc","Type":"ContainerDied","Data":"ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470"} Jul 06 01:24:58.480893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.480535 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6559bf84-ks5k6" event={"ID":"083f7be5-78a2-439b-99b9-309d2b5158cc","Type":"ContainerDied","Data":"fb40ca722cfde3033b018bd3c71ea7e8d5732bf1fca7da4925a8d438892bf66f"} Jul 06 01:24:58.480893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.480555 2571 scope.go:117] "RemoveContainer" containerID="ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470" Jul 06 01:24:58.489361 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.489343 2571 scope.go:117] "RemoveContainer" containerID="ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470" Jul 06 01:24:58.489626 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:24:58.489607 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470\": container with ID starting with ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470 not found: ID does not exist" containerID="ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470" Jul 06 01:24:58.489671 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.489635 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470"} err="failed to get container status \"ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470\": rpc error: code = NotFound desc = could not find container \"ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470\": container with ID starting with ac216f11b93030bdcff805c70bbf060a08fa2e32d480938fccb10b39bb202470 not found: ID does not exist" Jul 06 01:24:58.500910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.500886 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6559bf84-ks5k6"] Jul 06 01:24:58.503106 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:58.503084 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6559bf84-ks5k6"] Jul 06 01:24:59.269786 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:24:59.269754 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="083f7be5-78a2-439b-99b9-309d2b5158cc" path="/var/lib/kubelet/pods/083f7be5-78a2-439b-99b9-309d2b5158cc/volumes" Jul 06 01:25:07.506733 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:07.506692 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:08.069066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.069031 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk"] Jul 06 01:25:08.069333 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.069321 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="083f7be5-78a2-439b-99b9-309d2b5158cc" containerName="console" Jul 06 01:25:08.069375 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.069334 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="083f7be5-78a2-439b-99b9-309d2b5158cc" containerName="console" Jul 06 01:25:08.069413 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.069405 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="083f7be5-78a2-439b-99b9-309d2b5158cc" containerName="console" Jul 06 01:25:08.072290 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.072274 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.074789 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.074766 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 01:25:08.074911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.074857 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 01:25:08.075800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.075784 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbv5f\"" Jul 06 01:25:08.081394 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.081373 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk"] Jul 06 01:25:08.168123 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.168085 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.168325 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.168154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.168325 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.168253 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjlz6\" (UniqueName: \"kubernetes.io/projected/d2044ced-513b-4f55-9e82-ad4a304c2f4e-kube-api-access-hjlz6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.268776 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.268731 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.268978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.268803 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.268978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.268831 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjlz6\" (UniqueName: \"kubernetes.io/projected/d2044ced-513b-4f55-9e82-ad4a304c2f4e-kube-api-access-hjlz6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.269218 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.269195 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.269280 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.269205 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.277012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.276993 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjlz6\" (UniqueName: \"kubernetes.io/projected/d2044ced-513b-4f55-9e82-ad4a304c2f4e-kube-api-access-hjlz6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.381409 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.381328 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:08.504642 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.504617 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk"] Jul 06 01:25:08.507326 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:25:08.507297 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2044ced_513b_4f55_9e82_ad4a304c2f4e.slice/crio-50a3e55d27e2d3a1df2ccfc387db75361e8e975045ce007e0b908fa894dbdcf5 WatchSource:0}: Error finding container 50a3e55d27e2d3a1df2ccfc387db75361e8e975045ce007e0b908fa894dbdcf5: Status 404 returned error can't find the container with id 50a3e55d27e2d3a1df2ccfc387db75361e8e975045ce007e0b908fa894dbdcf5 Jul 06 01:25:08.516199 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.516170 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" event={"ID":"d2044ced-513b-4f55-9e82-ad4a304c2f4e","Type":"ContainerStarted","Data":"50a3e55d27e2d3a1df2ccfc387db75361e8e975045ce007e0b908fa894dbdcf5"} Jul 06 01:25:08.782311 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.782279 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:08.987111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.987084 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:25:08.990781 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.990762 2571 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 01:25:08.994036 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:08.994016 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:25:15.546841 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:15.546807 2571 generic.go:356] "Generic (PLEG): container finished" podID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerID="8b5018d97cb426b437ec5b712cb1d03352855d9217906b967d028c63cc0be38b" exitCode=0 Jul 06 01:25:15.547282 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:15.546890 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" event={"ID":"d2044ced-513b-4f55-9e82-ad4a304c2f4e","Type":"ContainerDied","Data":"8b5018d97cb426b437ec5b712cb1d03352855d9217906b967d028c63cc0be38b"} Jul 06 01:25:15.547863 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:15.547847 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:25:17.557548 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:17.557501 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" event={"ID":"d2044ced-513b-4f55-9e82-ad4a304c2f4e","Type":"ContainerStarted","Data":"f9c7cc04baec602d6e00d25e46d86f46d0fd99bc3878a8fc62f0193e5e5d25c1"} Jul 06 01:25:18.562640 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:18.562605 2571 generic.go:356] "Generic (PLEG): container finished" podID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerID="f9c7cc04baec602d6e00d25e46d86f46d0fd99bc3878a8fc62f0193e5e5d25c1" exitCode=0 Jul 06 01:25:18.563164 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:18.562668 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" event={"ID":"d2044ced-513b-4f55-9e82-ad4a304c2f4e","Type":"ContainerDied","Data":"f9c7cc04baec602d6e00d25e46d86f46d0fd99bc3878a8fc62f0193e5e5d25c1"} Jul 06 01:25:25.591174 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:25.591137 2571 generic.go:356] "Generic (PLEG): container finished" podID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerID="63913ff4ee13d56df9b5578e54ed10c68905760ed18e841fb8606ec2b09cd856" exitCode=0 Jul 06 01:25:25.591562 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:25.591214 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" event={"ID":"d2044ced-513b-4f55-9e82-ad4a304c2f4e","Type":"ContainerDied","Data":"63913ff4ee13d56df9b5578e54ed10c68905760ed18e841fb8606ec2b09cd856"} Jul 06 01:25:26.722794 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.722770 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:26.819818 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.819779 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-bundle\") pod \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " Jul 06 01:25:26.820008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.819869 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-util\") pod \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " Jul 06 01:25:26.820008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.819897 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjlz6\" (UniqueName: \"kubernetes.io/projected/d2044ced-513b-4f55-9e82-ad4a304c2f4e-kube-api-access-hjlz6\") pod \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\" (UID: \"d2044ced-513b-4f55-9e82-ad4a304c2f4e\") " Jul 06 01:25:26.820506 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.820477 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-bundle" (OuterVolumeSpecName: "bundle") pod "d2044ced-513b-4f55-9e82-ad4a304c2f4e" (UID: "d2044ced-513b-4f55-9e82-ad4a304c2f4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:25:26.822060 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.822039 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2044ced-513b-4f55-9e82-ad4a304c2f4e-kube-api-access-hjlz6" (OuterVolumeSpecName: "kube-api-access-hjlz6") pod "d2044ced-513b-4f55-9e82-ad4a304c2f4e" (UID: "d2044ced-513b-4f55-9e82-ad4a304c2f4e"). InnerVolumeSpecName "kube-api-access-hjlz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:25:26.826620 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.826580 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-util" (OuterVolumeSpecName: "util") pod "d2044ced-513b-4f55-9e82-ad4a304c2f4e" (UID: "d2044ced-513b-4f55-9e82-ad4a304c2f4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:25:26.921098 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.921067 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:26.921098 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.921096 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjlz6\" (UniqueName: \"kubernetes.io/projected/d2044ced-513b-4f55-9e82-ad4a304c2f4e-kube-api-access-hjlz6\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:26.921274 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:26.921108 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2044ced-513b-4f55-9e82-ad4a304c2f4e-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:27.600478 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:27.600377 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" event={"ID":"d2044ced-513b-4f55-9e82-ad4a304c2f4e","Type":"ContainerDied","Data":"50a3e55d27e2d3a1df2ccfc387db75361e8e975045ce007e0b908fa894dbdcf5"} Jul 06 01:25:27.600478 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:27.600406 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h89bk" Jul 06 01:25:27.600478 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:27.600424 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50a3e55d27e2d3a1df2ccfc387db75361e8e975045ce007e0b908fa894dbdcf5" Jul 06 01:25:29.038306 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:29.038270 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:29.889299 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:29.889268 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:30.947290 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947258 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss"] Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947512 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="pull" Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947524 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="pull" Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947548 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="util" Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947554 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="util" Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947572 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="extract" Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947577 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="extract" Jul 06 01:25:30.947735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.947624 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2044ced-513b-4f55-9e82-ad4a304c2f4e" containerName="extract" Jul 06 01:25:30.990396 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.990368 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss"] Jul 06 01:25:30.990525 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.990463 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:30.992905 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.992876 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 01:25:30.993044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.992910 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8tv4k\"" Jul 06 01:25:30.993044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:30.992876 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:25:31.051291 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.051259 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pmhss\" (UID: \"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.051437 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.051340 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vndpr\" (UniqueName: \"kubernetes.io/projected/2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd-kube-api-access-vndpr\") pod \"cert-manager-operator-controller-manager-55c444bf86-pmhss\" (UID: \"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.152462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.152426 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vndpr\" (UniqueName: \"kubernetes.io/projected/2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd-kube-api-access-vndpr\") pod \"cert-manager-operator-controller-manager-55c444bf86-pmhss\" (UID: \"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.152603 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.152470 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pmhss\" (UID: \"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.152803 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.152784 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pmhss\" (UID: \"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.161811 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.161791 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vndpr\" (UniqueName: \"kubernetes.io/projected/2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd-kube-api-access-vndpr\") pod \"cert-manager-operator-controller-manager-55c444bf86-pmhss\" (UID: \"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.299547 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.299473 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" Jul 06 01:25:31.438493 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.438460 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss"] Jul 06 01:25:31.449793 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:25:31.449772 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f093ad9_adcd_4fc4_ac95_ce6b36b4c9cd.slice/crio-207b80dbf78ff187149ecc4dd9ca79ee04873d1af835e8484ed312cbbbdf6757 WatchSource:0}: Error finding container 207b80dbf78ff187149ecc4dd9ca79ee04873d1af835e8484ed312cbbbdf6757: Status 404 returned error can't find the container with id 207b80dbf78ff187149ecc4dd9ca79ee04873d1af835e8484ed312cbbbdf6757 Jul 06 01:25:31.617932 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:31.617848 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" event={"ID":"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd","Type":"ContainerStarted","Data":"207b80dbf78ff187149ecc4dd9ca79ee04873d1af835e8484ed312cbbbdf6757"} Jul 06 01:25:32.650959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:32.650897 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:32.749503 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:32.749464 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:33.628254 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:33.628162 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" event={"ID":"2f093ad9-adcd-4fc4-ac95-ce6b36b4c9cd","Type":"ContainerStarted","Data":"529e2f43c1cdcaf4b437c121fe53bb0115c5d9f83f0610821bc98f41b8f3546f"} Jul 06 01:25:33.649088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:33.649041 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pmhss" podStartSLOduration=1.892000512 podStartE2EDuration="3.649024566s" totalImagesPullingTime="1.757024054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:25:33.647709589 +0000 UTC m=+325.070512644" watchObservedRunningTime="2026-07-06 01:25:33.649024566 +0000 UTC m=+325.071827620" Jul 06 01:25:34.032250 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.032212 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:34.182411 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.182374 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:34.349280 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.349178 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:34.438532 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.438502 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:34.786616 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.786585 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh"] Jul 06 01:25:34.789102 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.789084 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.791475 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.791449 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbv5f\"" Jul 06 01:25:34.791475 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.791451 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 01:25:34.792466 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.792451 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 01:25:34.798544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.798521 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh"] Jul 06 01:25:34.883358 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.883329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4v85\" (UniqueName: \"kubernetes.io/projected/5d52a6a6-c684-4de5-ae74-261fd32fefb0-kube-api-access-x4v85\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.883508 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.883371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.883508 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.883397 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.984177 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.984144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.984318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.984189 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.984318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.984238 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4v85\" (UniqueName: \"kubernetes.io/projected/5d52a6a6-c684-4de5-ae74-261fd32fefb0-kube-api-access-x4v85\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.984534 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.984517 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.984574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.984550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:34.995495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:34.995468 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4v85\" (UniqueName: \"kubernetes.io/projected/5d52a6a6-c684-4de5-ae74-261fd32fefb0-kube-api-access-x4v85\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:35.098639 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.098556 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:35.224181 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.224155 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh"] Jul 06 01:25:35.226691 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:25:35.226663 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d52a6a6_c684_4de5_ae74_261fd32fefb0.slice/crio-18d9c010670cf91b2ed820c800b281c35f55c694c06a8c850b8b86c7830c5cc6 WatchSource:0}: Error finding container 18d9c010670cf91b2ed820c800b281c35f55c694c06a8c850b8b86c7830c5cc6: Status 404 returned error can't find the container with id 18d9c010670cf91b2ed820c800b281c35f55c694c06a8c850b8b86c7830c5cc6 Jul 06 01:25:35.330723 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.330696 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bs6mb"] Jul 06 01:25:35.332714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.332698 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.335239 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.335217 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 01:25:35.335341 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.335268 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9kvhq\"" Jul 06 01:25:35.335408 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.335365 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 01:25:35.341176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.341149 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bs6mb"] Jul 06 01:25:35.386815 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.386796 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe00b7e7-0f7e-4b14-9333-66690d4cd322-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bs6mb\" (UID: \"fe00b7e7-0f7e-4b14-9333-66690d4cd322\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.386903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.386822 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wqk\" (UniqueName: \"kubernetes.io/projected/fe00b7e7-0f7e-4b14-9333-66690d4cd322-kube-api-access-m6wqk\") pod \"cert-manager-webhook-6486ffd997-bs6mb\" (UID: \"fe00b7e7-0f7e-4b14-9333-66690d4cd322\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.487781 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.487755 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe00b7e7-0f7e-4b14-9333-66690d4cd322-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bs6mb\" (UID: \"fe00b7e7-0f7e-4b14-9333-66690d4cd322\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.487916 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.487785 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wqk\" (UniqueName: \"kubernetes.io/projected/fe00b7e7-0f7e-4b14-9333-66690d4cd322-kube-api-access-m6wqk\") pod \"cert-manager-webhook-6486ffd997-bs6mb\" (UID: \"fe00b7e7-0f7e-4b14-9333-66690d4cd322\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.496115 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.496093 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe00b7e7-0f7e-4b14-9333-66690d4cd322-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bs6mb\" (UID: \"fe00b7e7-0f7e-4b14-9333-66690d4cd322\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.496245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.496230 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wqk\" (UniqueName: \"kubernetes.io/projected/fe00b7e7-0f7e-4b14-9333-66690d4cd322-kube-api-access-m6wqk\") pod \"cert-manager-webhook-6486ffd997-bs6mb\" (UID: \"fe00b7e7-0f7e-4b14-9333-66690d4cd322\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.636490 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.636403 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerID="c4bfe5af3315266a2a952ff8394986454e6e29f23b073f2e964c860bded95e1e" exitCode=0 Jul 06 01:25:35.636622 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.636486 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" event={"ID":"5d52a6a6-c684-4de5-ae74-261fd32fefb0","Type":"ContainerDied","Data":"c4bfe5af3315266a2a952ff8394986454e6e29f23b073f2e964c860bded95e1e"} Jul 06 01:25:35.636622 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.636544 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" event={"ID":"5d52a6a6-c684-4de5-ae74-261fd32fefb0","Type":"ContainerStarted","Data":"18d9c010670cf91b2ed820c800b281c35f55c694c06a8c850b8b86c7830c5cc6"} Jul 06 01:25:35.693427 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.693398 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:35.813875 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:35.813738 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bs6mb"] Jul 06 01:25:35.816538 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:25:35.816514 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe00b7e7_0f7e_4b14_9333_66690d4cd322.slice/crio-982ab107366cb1408321cfe98ca1dd45b71818b5a2765ac4606fea8675fdb41e WatchSource:0}: Error finding container 982ab107366cb1408321cfe98ca1dd45b71818b5a2765ac4606fea8675fdb41e: Status 404 returned error can't find the container with id 982ab107366cb1408321cfe98ca1dd45b71818b5a2765ac4606fea8675fdb41e Jul 06 01:25:36.643335 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:36.643300 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" event={"ID":"fe00b7e7-0f7e-4b14-9333-66690d4cd322","Type":"ContainerStarted","Data":"982ab107366cb1408321cfe98ca1dd45b71818b5a2765ac4606fea8675fdb41e"} Jul 06 01:25:36.910074 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:36.910031 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:37.119935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:37.119883 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:38.658041 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:38.658007 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" event={"ID":"5d52a6a6-c684-4de5-ae74-261fd32fefb0","Type":"ContainerStarted","Data":"9be4c66fe730192af5be5c67506d19df7bc77787a3d3a340b070c2ae2f2bf6c4"} Jul 06 01:25:39.451985 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.451937 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:39.525388 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.525360 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:39.664031 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.664001 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerID="9be4c66fe730192af5be5c67506d19df7bc77787a3d3a340b070c2ae2f2bf6c4" exitCode=0 Jul 06 01:25:39.664460 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.664089 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" event={"ID":"5d52a6a6-c684-4de5-ae74-261fd32fefb0","Type":"ContainerDied","Data":"9be4c66fe730192af5be5c67506d19df7bc77787a3d3a340b070c2ae2f2bf6c4"} Jul 06 01:25:39.665656 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.665631 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" event={"ID":"fe00b7e7-0f7e-4b14-9333-66690d4cd322","Type":"ContainerStarted","Data":"e34954a5a570549423f39f464defa7162307aa961729c89423f237b47e9dbc8b"} Jul 06 01:25:39.666173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.665734 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:39.694900 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:39.694856 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" podStartSLOduration=1.333153978 podStartE2EDuration="4.694843065s" totalImagesPullingTime="3.361689087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:25:39.693409251 +0000 UTC m=+331.116212325" watchObservedRunningTime="2026-07-06 01:25:39.694843065 +0000 UTC m=+331.117646120" Jul 06 01:25:40.672065 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:40.672029 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerID="e20ac485a280b731824a30067746abe98ea1b1a449a43281201b474fcdcf1df5" exitCode=0 Jul 06 01:25:40.672550 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:40.672116 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" event={"ID":"5d52a6a6-c684-4de5-ae74-261fd32fefb0","Type":"ContainerDied","Data":"e20ac485a280b731824a30067746abe98ea1b1a449a43281201b474fcdcf1df5"} Jul 06 01:25:41.801070 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.801049 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:41.839293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.839267 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-bundle\") pod \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " Jul 06 01:25:41.839425 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.839364 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4v85\" (UniqueName: \"kubernetes.io/projected/5d52a6a6-c684-4de5-ae74-261fd32fefb0-kube-api-access-x4v85\") pod \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " Jul 06 01:25:41.839425 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.839380 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-util\") pod \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\" (UID: \"5d52a6a6-c684-4de5-ae74-261fd32fefb0\") " Jul 06 01:25:41.839673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.839630 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-bundle" (OuterVolumeSpecName: "bundle") pod "5d52a6a6-c684-4de5-ae74-261fd32fefb0" (UID: "5d52a6a6-c684-4de5-ae74-261fd32fefb0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:25:41.841308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.841283 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d52a6a6-c684-4de5-ae74-261fd32fefb0-kube-api-access-x4v85" (OuterVolumeSpecName: "kube-api-access-x4v85") pod "5d52a6a6-c684-4de5-ae74-261fd32fefb0" (UID: "5d52a6a6-c684-4de5-ae74-261fd32fefb0"). InnerVolumeSpecName "kube-api-access-x4v85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:25:41.843715 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.843683 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-util" (OuterVolumeSpecName: "util") pod "5d52a6a6-c684-4de5-ae74-261fd32fefb0" (UID: "5d52a6a6-c684-4de5-ae74-261fd32fefb0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:25:41.940032 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.939924 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4v85\" (UniqueName: \"kubernetes.io/projected/5d52a6a6-c684-4de5-ae74-261fd32fefb0-kube-api-access-x4v85\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:41.940032 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.939975 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:41.940032 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:41.939985 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d52a6a6-c684-4de5-ae74-261fd32fefb0-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:42.682309 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:42.682280 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" Jul 06 01:25:42.682479 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:42.682281 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxqrh" event={"ID":"5d52a6a6-c684-4de5-ae74-261fd32fefb0","Type":"ContainerDied","Data":"18d9c010670cf91b2ed820c800b281c35f55c694c06a8c850b8b86c7830c5cc6"} Jul 06 01:25:42.682479 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:42.682401 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18d9c010670cf91b2ed820c800b281c35f55c694c06a8c850b8b86c7830c5cc6" Jul 06 01:25:44.043322 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:44.043283 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:44.144298 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:44.144249 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:44.197738 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:44.197696 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:45.363455 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363422 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fqzsl"] Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363688 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="util" Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363699 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="util" Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363707 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="extract" Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363713 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="extract" Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363726 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="pull" Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363732 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="pull" Jul 06 01:25:45.363805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.363778 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d52a6a6-c684-4de5-ae74-261fd32fefb0" containerName="extract" Jul 06 01:25:45.366744 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.366728 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.369144 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.369124 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x7q7g\"" Jul 06 01:25:45.375809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.375787 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fqzsl"] Jul 06 01:25:45.467920 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.467887 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22x96\" (UniqueName: \"kubernetes.io/projected/1a50aa1b-ef4e-49dd-a754-ca711c5d925e-kube-api-access-22x96\") pod \"cert-manager-55b4d954d5-fqzsl\" (UID: \"1a50aa1b-ef4e-49dd-a754-ca711c5d925e\") " pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.468098 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.467963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a50aa1b-ef4e-49dd-a754-ca711c5d925e-bound-sa-token\") pod \"cert-manager-55b4d954d5-fqzsl\" (UID: \"1a50aa1b-ef4e-49dd-a754-ca711c5d925e\") " pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.568549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.568518 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a50aa1b-ef4e-49dd-a754-ca711c5d925e-bound-sa-token\") pod \"cert-manager-55b4d954d5-fqzsl\" (UID: \"1a50aa1b-ef4e-49dd-a754-ca711c5d925e\") " pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.568716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.568568 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22x96\" (UniqueName: \"kubernetes.io/projected/1a50aa1b-ef4e-49dd-a754-ca711c5d925e-kube-api-access-22x96\") pod \"cert-manager-55b4d954d5-fqzsl\" (UID: \"1a50aa1b-ef4e-49dd-a754-ca711c5d925e\") " pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.576337 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.576310 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a50aa1b-ef4e-49dd-a754-ca711c5d925e-bound-sa-token\") pod \"cert-manager-55b4d954d5-fqzsl\" (UID: \"1a50aa1b-ef4e-49dd-a754-ca711c5d925e\") " pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.576594 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.576573 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22x96\" (UniqueName: \"kubernetes.io/projected/1a50aa1b-ef4e-49dd-a754-ca711c5d925e-kube-api-access-22x96\") pod \"cert-manager-55b4d954d5-fqzsl\" (UID: \"1a50aa1b-ef4e-49dd-a754-ca711c5d925e\") " pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.675066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.675037 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bs6mb" Jul 06 01:25:45.675225 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.675186 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fqzsl" Jul 06 01:25:45.804163 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:45.804129 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fqzsl"] Jul 06 01:25:45.807231 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:25:45.807205 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a50aa1b_ef4e_49dd_a754_ca711c5d925e.slice/crio-a3067d11d93df320f70b90b3e9aa21f74bdeb79e89009d2a76a8fa55b9351849 WatchSource:0}: Error finding container a3067d11d93df320f70b90b3e9aa21f74bdeb79e89009d2a76a8fa55b9351849: Status 404 returned error can't find the container with id a3067d11d93df320f70b90b3e9aa21f74bdeb79e89009d2a76a8fa55b9351849 Jul 06 01:25:46.698923 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:46.698883 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fqzsl" event={"ID":"1a50aa1b-ef4e-49dd-a754-ca711c5d925e","Type":"ContainerStarted","Data":"26a5d215eacf0f33824f91c3c236fa63975bd210d89d0dd8a45d0c7de210ec1c"} Jul 06 01:25:46.698923 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:46.698927 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fqzsl" event={"ID":"1a50aa1b-ef4e-49dd-a754-ca711c5d925e","Type":"ContainerStarted","Data":"a3067d11d93df320f70b90b3e9aa21f74bdeb79e89009d2a76a8fa55b9351849"} Jul 06 01:25:46.716040 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:46.715993 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fqzsl" podStartSLOduration=1.7159694989999998 podStartE2EDuration="1.715969499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:25:46.715166828 +0000 UTC m=+338.137969886" watchObservedRunningTime="2026-07-06 01:25:46.715969499 +0000 UTC m=+338.138772547" Jul 06 01:25:46.978090 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:46.977999 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:47.080280 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:47.080250 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:53.674364 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:53.674327 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:53.774520 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:53.774468 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:55.184012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.183965 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2"] Jul 06 01:25:55.187389 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.187372 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.189765 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.189743 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 01:25:55.190582 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.190564 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 01:25:55.190661 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.190568 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbv5f\"" Jul 06 01:25:55.195132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.195092 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2"] Jul 06 01:25:55.247224 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.247194 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.247357 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.247231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.247357 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.247307 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzzdh\" (UniqueName: \"kubernetes.io/projected/315dc69c-479a-4fc2-8dcf-70ad5716ea02-kube-api-access-fzzdh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.347735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.347704 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.347735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.347734 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.348001 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.347792 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzzdh\" (UniqueName: \"kubernetes.io/projected/315dc69c-479a-4fc2-8dcf-70ad5716ea02-kube-api-access-fzzdh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.348205 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.348185 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.348277 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.348221 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.356485 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.356466 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzzdh\" (UniqueName: \"kubernetes.io/projected/315dc69c-479a-4fc2-8dcf-70ad5716ea02-kube-api-access-fzzdh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.494634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.494532 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:25:55.498060 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.498039 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:55.623204 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.623045 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2"] Jul 06 01:25:55.625818 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:25:55.625786 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315dc69c_479a_4fc2_8dcf_70ad5716ea02.slice/crio-643b9dd8f1effba6ce4e76faeb05f99b281c522dc4970e24a2749ecbce48f5cf WatchSource:0}: Error finding container 643b9dd8f1effba6ce4e76faeb05f99b281c522dc4970e24a2749ecbce48f5cf: Status 404 returned error can't find the container with id 643b9dd8f1effba6ce4e76faeb05f99b281c522dc4970e24a2749ecbce48f5cf Jul 06 01:25:55.742685 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.742656 2571 generic.go:356] "Generic (PLEG): container finished" podID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerID="9f4ddb1bbceeb9bed299af33852032283d4b1bf198e6dcb3d111b82a91188a1d" exitCode=0 Jul 06 01:25:55.742810 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.742742 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" event={"ID":"315dc69c-479a-4fc2-8dcf-70ad5716ea02","Type":"ContainerDied","Data":"9f4ddb1bbceeb9bed299af33852032283d4b1bf198e6dcb3d111b82a91188a1d"} Jul 06 01:25:55.742810 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:55.742796 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" event={"ID":"315dc69c-479a-4fc2-8dcf-70ad5716ea02","Type":"ContainerStarted","Data":"643b9dd8f1effba6ce4e76faeb05f99b281c522dc4970e24a2749ecbce48f5cf"} Jul 06 01:25:56.748767 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:56.748731 2571 generic.go:356] "Generic (PLEG): container finished" podID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerID="8bc85a4a1c4559211f438f66dd37dec06e623539068e3dd3250c63787208e768" exitCode=0 Jul 06 01:25:56.749160 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:56.748776 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" event={"ID":"315dc69c-479a-4fc2-8dcf-70ad5716ea02","Type":"ContainerDied","Data":"8bc85a4a1c4559211f438f66dd37dec06e623539068e3dd3250c63787208e768"} Jul 06 01:25:57.757680 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:57.757644 2571 generic.go:356] "Generic (PLEG): container finished" podID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerID="26bf874ef7361cb268484647b99b96527d84bbf131942ce51dbe10db5dcec368" exitCode=0 Jul 06 01:25:57.758079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:57.757717 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" event={"ID":"315dc69c-479a-4fc2-8dcf-70ad5716ea02","Type":"ContainerDied","Data":"26bf874ef7361cb268484647b99b96527d84bbf131942ce51dbe10db5dcec368"} Jul 06 01:25:58.910075 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.910048 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:58.980712 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.980684 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-bundle\") pod \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " Jul 06 01:25:58.980856 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.980737 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzzdh\" (UniqueName: \"kubernetes.io/projected/315dc69c-479a-4fc2-8dcf-70ad5716ea02-kube-api-access-fzzdh\") pod \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " Jul 06 01:25:58.980856 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.980770 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-util\") pod \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\" (UID: \"315dc69c-479a-4fc2-8dcf-70ad5716ea02\") " Jul 06 01:25:58.981396 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.981367 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-bundle" (OuterVolumeSpecName: "bundle") pod "315dc69c-479a-4fc2-8dcf-70ad5716ea02" (UID: "315dc69c-479a-4fc2-8dcf-70ad5716ea02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:25:58.982878 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.982856 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315dc69c-479a-4fc2-8dcf-70ad5716ea02-kube-api-access-fzzdh" (OuterVolumeSpecName: "kube-api-access-fzzdh") pod "315dc69c-479a-4fc2-8dcf-70ad5716ea02" (UID: "315dc69c-479a-4fc2-8dcf-70ad5716ea02"). InnerVolumeSpecName "kube-api-access-fzzdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:25:58.986235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:58.986211 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-util" (OuterVolumeSpecName: "util") pod "315dc69c-479a-4fc2-8dcf-70ad5716ea02" (UID: "315dc69c-479a-4fc2-8dcf-70ad5716ea02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:25:59.081484 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:59.081409 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:59.081484 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:59.081440 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzzdh\" (UniqueName: \"kubernetes.io/projected/315dc69c-479a-4fc2-8dcf-70ad5716ea02-kube-api-access-fzzdh\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:59.081484 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:59.081454 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315dc69c-479a-4fc2-8dcf-70ad5716ea02-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:25:59.768018 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:59.767984 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" Jul 06 01:25:59.768208 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:59.767984 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbc5c2" event={"ID":"315dc69c-479a-4fc2-8dcf-70ad5716ea02","Type":"ContainerDied","Data":"643b9dd8f1effba6ce4e76faeb05f99b281c522dc4970e24a2749ecbce48f5cf"} Jul 06 01:25:59.768208 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:25:59.768106 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="643b9dd8f1effba6ce4e76faeb05f99b281c522dc4970e24a2749ecbce48f5cf" Jul 06 01:26:05.796610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.796528 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:05.844221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844188 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h"] Jul 06 01:26:05.844490 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844478 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="extract" Jul 06 01:26:05.844536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844492 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="extract" Jul 06 01:26:05.844536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844508 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="util" Jul 06 01:26:05.844536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844514 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="util" Jul 06 01:26:05.844536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844522 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="pull" Jul 06 01:26:05.844536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844527 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="pull" Jul 06 01:26:05.844689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.844572 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="315dc69c-479a-4fc2-8dcf-70ad5716ea02" containerName="extract" Jul 06 01:26:05.847411 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.847396 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:05.849886 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.849864 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:26:05.850839 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.850812 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 01:26:05.850964 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.850849 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 01:26:05.850964 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.850848 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 01:26:05.850964 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.850870 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 01:26:05.851152 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.851095 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5x8h4\"" Jul 06 01:26:05.856825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.856805 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h"] Jul 06 01:26:05.877667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.877638 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:05.936880 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.936854 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-metrics-cert\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:05.937012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.936890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-cert\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:05.937012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.936922 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj7t6\" (UniqueName: \"kubernetes.io/projected/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-kube-api-access-mj7t6\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:05.937012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:05.937002 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-manager-config\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.037864 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.037830 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-metrics-cert\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.038072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.037872 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-cert\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.038072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.038000 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj7t6\" (UniqueName: \"kubernetes.io/projected/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-kube-api-access-mj7t6\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.038178 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.038081 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-manager-config\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.038753 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.038729 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-manager-config\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.040323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.040301 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-metrics-cert\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.040411 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.040401 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-cert\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.046063 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.046040 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj7t6\" (UniqueName: \"kubernetes.io/projected/c9f8fa13-d3c0-4b2f-af07-5e1addd2b697-kube-api-access-mj7t6\") pod \"lws-controller-manager-76dc9d4b5b-5lr7h\" (UID: \"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697\") " pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.157151 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.157080 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:06.304829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.304799 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h"] Jul 06 01:26:06.305660 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:26:06.305635 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f8fa13_d3c0_4b2f_af07_5e1addd2b697.slice/crio-c8f347765dadf1365ea7304fbb65be6ea776de6ae40b02d0a9794a309ccaa7d1 WatchSource:0}: Error finding container c8f347765dadf1365ea7304fbb65be6ea776de6ae40b02d0a9794a309ccaa7d1: Status 404 returned error can't find the container with id c8f347765dadf1365ea7304fbb65be6ea776de6ae40b02d0a9794a309ccaa7d1 Jul 06 01:26:06.798789 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:06.798751 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" event={"ID":"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697","Type":"ContainerStarted","Data":"c8f347765dadf1365ea7304fbb65be6ea776de6ae40b02d0a9794a309ccaa7d1"} Jul 06 01:26:08.274274 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:08.274238 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:08.373014 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:08.372936 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:08.808806 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:08.808768 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" event={"ID":"c9f8fa13-d3c0-4b2f-af07-5e1addd2b697","Type":"ContainerStarted","Data":"b905c1920e11e88533cdce19de0e30a499f838ce1edb7b9802e6fb8e331838e7"} Jul 06 01:26:08.808991 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:08.808845 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:08.835274 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:08.835222 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" podStartSLOduration=2.283464262 podStartE2EDuration="3.835204572s" totalImagesPullingTime="1.55174031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:08.83332234 +0000 UTC m=+360.256125413" watchObservedRunningTime="2026-07-06 01:26:08.835204572 +0000 UTC m=+360.258007691" Jul 06 01:26:08.892430 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:08.892397 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.100851 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.100765 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.211156 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.211125 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.280659 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.280631 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd"] Jul 06 01:26:09.283919 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.283904 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.287274 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.287227 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 01:26:09.287392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.287278 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 01:26:09.287392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.287383 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxjmq\"" Jul 06 01:26:09.287471 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.287392 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 01:26:09.287678 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.287661 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 01:26:09.308957 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.308918 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd"] Jul 06 01:26:09.367938 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.367861 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/052c5c48-1883-4235-97fe-8c4393b1e12c-tmp\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.367938 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.367911 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4hf\" (UniqueName: \"kubernetes.io/projected/052c5c48-1883-4235-97fe-8c4393b1e12c-kube-api-access-kj4hf\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.368158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.367963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/052c5c48-1883-4235-97fe-8c4393b1e12c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.368158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.368028 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/052c5c48-1883-4235-97fe-8c4393b1e12c-manifests\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.368158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.368061 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/052c5c48-1883-4235-97fe-8c4393b1e12c-webhook-cert\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.468500 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.468457 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/052c5c48-1883-4235-97fe-8c4393b1e12c-tmp\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.468689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.468529 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4hf\" (UniqueName: \"kubernetes.io/projected/052c5c48-1883-4235-97fe-8c4393b1e12c-kube-api-access-kj4hf\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.468689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.468566 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/052c5c48-1883-4235-97fe-8c4393b1e12c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.468689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.468628 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/052c5c48-1883-4235-97fe-8c4393b1e12c-manifests\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.468689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.468664 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/052c5c48-1883-4235-97fe-8c4393b1e12c-webhook-cert\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.469042 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.469015 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/052c5c48-1883-4235-97fe-8c4393b1e12c-manifests\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.470924 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.470892 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/052c5c48-1883-4235-97fe-8c4393b1e12c-tmp\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.471437 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.471414 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/052c5c48-1883-4235-97fe-8c4393b1e12c-webhook-cert\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.471547 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.471518 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/052c5c48-1883-4235-97fe-8c4393b1e12c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.477401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.477381 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4hf\" (UniqueName: \"kubernetes.io/projected/052c5c48-1883-4235-97fe-8c4393b1e12c-kube-api-access-kj4hf\") pod \"opendatahub-operator-controller-manager-d8fbf9755-bx6zd\" (UID: \"052c5c48-1883-4235-97fe-8c4393b1e12c\") " pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.502623 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.502588 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.593814 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.593782 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:09.604801 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.604772 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.697800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.697765 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.730633 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.730610 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd"] Jul 06 01:26:09.732467 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:26:09.732436 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052c5c48_1883_4235_97fe_8c4393b1e12c.slice/crio-13081dbb6aaa927d9b23be504c94c3742873f808f3fcafff4e56c15a191e2e3a WatchSource:0}: Error finding container 13081dbb6aaa927d9b23be504c94c3742873f808f3fcafff4e56c15a191e2e3a: Status 404 returned error can't find the container with id 13081dbb6aaa927d9b23be504c94c3742873f808f3fcafff4e56c15a191e2e3a Jul 06 01:26:09.765483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.765459 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.814394 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.814366 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" event={"ID":"052c5c48-1883-4235-97fe-8c4393b1e12c","Type":"ContainerStarted","Data":"13081dbb6aaa927d9b23be504c94c3742873f808f3fcafff4e56c15a191e2e3a"} Jul 06 01:26:09.867147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.867115 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:09.967352 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:09.967316 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:13.838418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:13.838383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" event={"ID":"052c5c48-1883-4235-97fe-8c4393b1e12c","Type":"ContainerStarted","Data":"1ce08c753583603c42a87f4579a28211a5d16eadbf56310d4f50e8f497938405"} Jul 06 01:26:14.844097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:14.844055 2571 generic.go:356] "Generic (PLEG): container finished" podID="052c5c48-1883-4235-97fe-8c4393b1e12c" containerID="1ce08c753583603c42a87f4579a28211a5d16eadbf56310d4f50e8f497938405" exitCode=0 Jul 06 01:26:14.844598 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:14.844129 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" event={"ID":"052c5c48-1883-4235-97fe-8c4393b1e12c","Type":"ContainerDied","Data":"1ce08c753583603c42a87f4579a28211a5d16eadbf56310d4f50e8f497938405"} Jul 06 01:26:15.850428 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:15.850393 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" event={"ID":"052c5c48-1883-4235-97fe-8c4393b1e12c","Type":"ContainerStarted","Data":"7a216b54277f97a21fbffe72e54adb3083c30535ebd6c48d3fa18fe5ed127b19"} Jul 06 01:26:15.850873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:15.850514 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:15.871967 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:15.871913 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" podStartSLOduration=2.130453585 podStartE2EDuration="6.871899548s" totalImagesPullingTime="3.669251118s" totalInitContainerRuntime="1.072194845s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:15.870096627 +0000 UTC m=+367.292899682" watchObservedRunningTime="2026-07-06 01:26:15.871899548 +0000 UTC m=+367.294702603" Jul 06 01:26:19.816703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:19.816671 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76dc9d4b5b-5lr7h" Jul 06 01:26:21.293216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:21.293183 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:21.391960 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:21.391915 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:26.857276 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:26.857240 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d8fbf9755-bx6zd" Jul 06 01:26:28.186796 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:28.186758 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:28.346400 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:28.346355 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:29.412075 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:29.412029 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:29.509456 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:29.509417 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:29.626215 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:29.626174 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:29.724192 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:29.724106 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:30.098026 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:30.097922 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:30.196317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:30.196279 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:30.277762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:30.277723 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:30.693249 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:30.693206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:30.755739 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:30.755706 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:31.685700 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:31.685655 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:36.847698 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:36.847663 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:36.948516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:36.948468 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:37.506809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.506778 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg"] Jul 06 01:26:37.515792 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.515766 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.518350 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.518329 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 01:26:37.518616 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.518600 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7kv69\"" Jul 06 01:26:37.527627 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.527603 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg"] Jul 06 01:26:37.532603 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.532578 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:37.603516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603478 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603558 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603588 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10789b-4990-4cb3-b629-07e8fd506dbb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603777 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603667 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603777 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603708 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603777 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603728 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603777 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.603926 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.603831 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt5qh\" (UniqueName: \"kubernetes.io/projected/fc10789b-4990-4cb3-b629-07e8fd506dbb-kube-api-access-rt5qh\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.704782 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.704742 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.704782 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.704787 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.704808 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.704929 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705008 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt5qh\" (UniqueName: \"kubernetes.io/projected/fc10789b-4990-4cb3-b629-07e8fd506dbb-kube-api-access-rt5qh\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705055 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705090 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705125 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705164 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10789b-4990-4cb3-b629-07e8fd506dbb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705227 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705342 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705495 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705594 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705575 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.705899 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.705877 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10789b-4990-4cb3-b629-07e8fd506dbb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.707404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.707387 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.707485 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.707451 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.725380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.725350 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10789b-4990-4cb3-b629-07e8fd506dbb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.729714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.729693 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt5qh\" (UniqueName: \"kubernetes.io/projected/fc10789b-4990-4cb3-b629-07e8fd506dbb-kube-api-access-rt5qh\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dqjdg\" (UID: \"fc10789b-4990-4cb3-b629-07e8fd506dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.827220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.827108 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:37.831715 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.831670 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:37.927633 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.927599 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:37.963329 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:37.963304 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg"] Jul 06 01:26:37.965425 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:26:37.965396 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc10789b_4990_4cb3_b629_07e8fd506dbb.slice/crio-1fed75de9f54a29999fbb315af9ffb5d084414c5845676c8deb866a78d798fe3 WatchSource:0}: Error finding container 1fed75de9f54a29999fbb315af9ffb5d084414c5845676c8deb866a78d798fe3: Status 404 returned error can't find the container with id 1fed75de9f54a29999fbb315af9ffb5d084414c5845676c8deb866a78d798fe3 Jul 06 01:26:38.073822 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.073782 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn"] Jul 06 01:26:38.078249 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.078188 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.080847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.080810 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 01:26:38.080985 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.080809 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 01:26:38.080985 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.080913 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 01:26:38.081104 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.081008 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gq4dv\"" Jul 06 01:26:38.088790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.088764 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn"] Jul 06 01:26:38.109968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.109907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.109968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.109969 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.110175 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.110042 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b42bdba-14c6-48c7-900f-821da4248364-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.110175 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.110071 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.110175 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.110117 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b42bdba-14c6-48c7-900f-821da4248364-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.110175 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.110152 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b42bdba-14c6-48c7-900f-821da4248364-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.110319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.110190 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzs2\" (UniqueName: \"kubernetes.io/projected/9b42bdba-14c6-48c7-900f-821da4248364-kube-api-access-gdzs2\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210774 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b42bdba-14c6-48c7-900f-821da4248364-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210820 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b42bdba-14c6-48c7-900f-821da4248364-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210853 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzs2\" (UniqueName: \"kubernetes.io/projected/9b42bdba-14c6-48c7-900f-821da4248364-kube-api-access-gdzs2\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210885 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210906 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210933 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b42bdba-14c6-48c7-900f-821da4248364-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.210997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.210970 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.211653 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.211623 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b42bdba-14c6-48c7-900f-821da4248364-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.213477 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.213452 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b42bdba-14c6-48c7-900f-821da4248364-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.213570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.213488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.213570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.213508 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.213674 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.213585 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b42bdba-14c6-48c7-900f-821da4248364-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.228257 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.228227 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b42bdba-14c6-48c7-900f-821da4248364-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.228348 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.228267 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzs2\" (UniqueName: \"kubernetes.io/projected/9b42bdba-14c6-48c7-900f-821da4248364-kube-api-access-gdzs2\") pod \"istiod-openshift-gateway-94bb8fbfd-vdpzn\" (UID: \"9b42bdba-14c6-48c7-900f-821da4248364\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.388488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.388398 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:38.517009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.516983 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn"] Jul 06 01:26:38.518563 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:26:38.518522 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b42bdba_14c6_48c7_900f_821da4248364.slice/crio-6744d4a7b5d76b3fa1534ad94e9a1d62f79aa7921bdb33a1f28528d88778a634 WatchSource:0}: Error finding container 6744d4a7b5d76b3fa1534ad94e9a1d62f79aa7921bdb33a1f28528d88778a634: Status 404 returned error can't find the container with id 6744d4a7b5d76b3fa1534ad94e9a1d62f79aa7921bdb33a1f28528d88778a634 Jul 06 01:26:38.950628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.950595 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" event={"ID":"9b42bdba-14c6-48c7-900f-821da4248364","Type":"ContainerStarted","Data":"6744d4a7b5d76b3fa1534ad94e9a1d62f79aa7921bdb33a1f28528d88778a634"} Jul 06 01:26:38.951854 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:38.951827 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" event={"ID":"fc10789b-4990-4cb3-b629-07e8fd506dbb","Type":"ContainerStarted","Data":"1fed75de9f54a29999fbb315af9ffb5d084414c5845676c8deb866a78d798fe3"} Jul 06 01:26:40.694760 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:40.694721 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:40.784744 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:40.784692 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:40.947980 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:40.947861 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:41.047582 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.047543 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:41.222881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.222792 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:41.941398 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.941351 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:26:41.941707 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.941444 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:26:41.946379 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.946334 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:26:41.946431 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.946408 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:26:41.946505 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:41.946440 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:26:42.973579 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:42.973544 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" event={"ID":"9b42bdba-14c6-48c7-900f-821da4248364","Type":"ContainerStarted","Data":"030257de8e4487024e52d2ab7a2effbf4bb1538d410f6cac6995ba12383d3345"} Jul 06 01:26:42.974021 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:42.973677 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:26:42.975105 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:42.975081 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" event={"ID":"fc10789b-4990-4cb3-b629-07e8fd506dbb","Type":"ContainerStarted","Data":"3bd7adcf039cb24b3341d581d0682e362d8dce590d3329b3a741d28fae9e9493"} Jul 06 01:26:42.994965 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:42.994905 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" podStartSLOduration=1.5744294380000001 podStartE2EDuration="4.994891913s" totalImagesPullingTime="3.420462475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:42.993704079 +0000 UTC m=+394.416507143" watchObservedRunningTime="2026-07-06 01:26:42.994891913 +0000 UTC m=+394.417694968" Jul 06 01:26:43.013489 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:43.013441 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" podStartSLOduration=2.035075446 podStartE2EDuration="6.013425011s" totalImagesPullingTime="3.978349565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:43.011653951 +0000 UTC m=+394.434457022" watchObservedRunningTime="2026-07-06 01:26:43.013425011 +0000 UTC m=+394.436228066" Jul 06 01:26:43.832234 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:43.832193 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:43.837066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:43.837033 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:43.980107 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:43.980067 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:43.981084 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:43.981066 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dqjdg" Jul 06 01:26:43.981754 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:26:43.981735 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vdpzn" Jul 06 01:27:05.337309 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:05.337264 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:05.397276 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:05.397234 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:05.883062 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:05.883029 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:05.985153 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:05.985117 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:17.857523 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:17.857483 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:29.835824 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:29.835789 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:29.895254 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:29.895214 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:30.734497 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:30.734464 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:30.817746 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:30.817712 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:45.206697 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.206613 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4"] Jul 06 01:27:45.210330 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.210309 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.212535 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.212513 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 01:27:45.212634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.212554 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 01:27:45.213320 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.213299 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wsd9j\"" Jul 06 01:27:45.217017 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.216996 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4"] Jul 06 01:27:45.297680 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.297653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc698\" (UniqueName: \"kubernetes.io/projected/80c44866-8940-4e80-b8c5-60e11dacc8f1-kube-api-access-cc698\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.297846 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.297688 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.297846 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.297740 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.399092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.399058 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.399253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.399122 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc698\" (UniqueName: \"kubernetes.io/projected/80c44866-8940-4e80-b8c5-60e11dacc8f1-kube-api-access-cc698\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.399253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.399157 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.399440 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.399409 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.399509 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.399460 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.407202 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.407178 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc698\" (UniqueName: \"kubernetes.io/projected/80c44866-8940-4e80-b8c5-60e11dacc8f1-kube-api-access-cc698\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.520072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.519977 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:45.648148 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:45.648128 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4"] Jul 06 01:27:45.650503 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:27:45.650475 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c44866_8940_4e80_b8c5_60e11dacc8f1.slice/crio-5b3c0923dc2199161dc94b3e46b435cbb95a93e9b82c0498b9261dd1e573eadb WatchSource:0}: Error finding container 5b3c0923dc2199161dc94b3e46b435cbb95a93e9b82c0498b9261dd1e573eadb: Status 404 returned error can't find the container with id 5b3c0923dc2199161dc94b3e46b435cbb95a93e9b82c0498b9261dd1e573eadb Jul 06 01:27:46.006903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.006869 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k"] Jul 06 01:27:46.010342 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.010326 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.016917 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.016822 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k"] Jul 06 01:27:46.105217 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.105189 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.105367 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.105231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcns\" (UniqueName: \"kubernetes.io/projected/4d783263-7570-4e19-8ff7-b64f60542547-kube-api-access-gqcns\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.105367 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.105265 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.205650 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.205618 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.205807 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.205675 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.205807 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.205704 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcns\" (UniqueName: \"kubernetes.io/projected/4d783263-7570-4e19-8ff7-b64f60542547-kube-api-access-gqcns\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.206055 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.206037 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.206096 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.206070 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.214279 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.214251 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcns\" (UniqueName: \"kubernetes.io/projected/4d783263-7570-4e19-8ff7-b64f60542547-kube-api-access-gqcns\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.263457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.263380 2571 generic.go:356] "Generic (PLEG): container finished" podID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerID="509f4d471b98ca9460186c2690d1d25dbc3288c9f086de9d99beace678af8f92" exitCode=0 Jul 06 01:27:46.263597 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.263471 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" event={"ID":"80c44866-8940-4e80-b8c5-60e11dacc8f1","Type":"ContainerDied","Data":"509f4d471b98ca9460186c2690d1d25dbc3288c9f086de9d99beace678af8f92"} Jul 06 01:27:46.263597 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.263560 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" event={"ID":"80c44866-8940-4e80-b8c5-60e11dacc8f1","Type":"ContainerStarted","Data":"5b3c0923dc2199161dc94b3e46b435cbb95a93e9b82c0498b9261dd1e573eadb"} Jul 06 01:27:46.320038 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.320015 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:46.407359 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.407326 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd"] Jul 06 01:27:46.411714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.411689 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.418015 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.417780 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd"] Jul 06 01:27:46.449414 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.449353 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k"] Jul 06 01:27:46.451638 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:27:46.451608 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d783263_7570_4e19_8ff7_b64f60542547.slice/crio-553ec0deb18c50939632afb171d518bca12749c060e53e715497244b3420b60c WatchSource:0}: Error finding container 553ec0deb18c50939632afb171d518bca12749c060e53e715497244b3420b60c: Status 404 returned error can't find the container with id 553ec0deb18c50939632afb171d518bca12749c060e53e715497244b3420b60c Jul 06 01:27:46.508587 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.508563 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.508684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.508602 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9s58\" (UniqueName: \"kubernetes.io/projected/798d47b7-171b-4941-ac3c-dae21fc6ad70-kube-api-access-r9s58\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.508684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.508664 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.609882 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.609852 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.610013 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.609911 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.610013 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.609937 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9s58\" (UniqueName: \"kubernetes.io/projected/798d47b7-171b-4941-ac3c-dae21fc6ad70-kube-api-access-r9s58\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.610313 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.610292 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.610313 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.610304 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.618100 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.618081 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9s58\" (UniqueName: \"kubernetes.io/projected/798d47b7-171b-4941-ac3c-dae21fc6ad70-kube-api-access-r9s58\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.728214 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.728176 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:46.855070 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:46.855041 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd"] Jul 06 01:27:46.856047 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:27:46.856020 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798d47b7_171b_4941_ac3c_dae21fc6ad70.slice/crio-39c437f7f950fcd4fe6cec90b5c49354db69876926cc39f66a291737cf343043 WatchSource:0}: Error finding container 39c437f7f950fcd4fe6cec90b5c49354db69876926cc39f66a291737cf343043: Status 404 returned error can't find the container with id 39c437f7f950fcd4fe6cec90b5c49354db69876926cc39f66a291737cf343043 Jul 06 01:27:47.010118 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.010090 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq"] Jul 06 01:27:47.013620 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.013596 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.023060 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.023027 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq"] Jul 06 01:27:47.114292 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.114264 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.114399 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.114381 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c67sj\" (UniqueName: \"kubernetes.io/projected/879d37c3-5e16-46f2-a595-6a878827c6e2-kube-api-access-c67sj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.114464 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.114441 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.215225 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.215194 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.215518 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.215251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.215518 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.215296 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c67sj\" (UniqueName: \"kubernetes.io/projected/879d37c3-5e16-46f2-a595-6a878827c6e2-kube-api-access-c67sj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.215591 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.215524 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.215625 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.215581 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.224329 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.224307 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c67sj\" (UniqueName: \"kubernetes.io/projected/879d37c3-5e16-46f2-a595-6a878827c6e2-kube-api-access-c67sj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.269574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.269551 2571 generic.go:356] "Generic (PLEG): container finished" podID="4d783263-7570-4e19-8ff7-b64f60542547" containerID="a5a766e99897d7569b5b373e720a2359ab0feef67cbefd32b98e647123acbc41" exitCode=0 Jul 06 01:27:47.271443 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.271417 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" event={"ID":"4d783263-7570-4e19-8ff7-b64f60542547","Type":"ContainerDied","Data":"a5a766e99897d7569b5b373e720a2359ab0feef67cbefd32b98e647123acbc41"} Jul 06 01:27:47.271543 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.271466 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" event={"ID":"4d783263-7570-4e19-8ff7-b64f60542547","Type":"ContainerStarted","Data":"553ec0deb18c50939632afb171d518bca12749c060e53e715497244b3420b60c"} Jul 06 01:27:47.271614 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.271596 2571 generic.go:356] "Generic (PLEG): container finished" podID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerID="1035f5a6df72ef7f4559e9f4a7e5df101fb8f25dcb0d7ae21c260664cb49e0ee" exitCode=0 Jul 06 01:27:47.271686 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.271672 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" event={"ID":"80c44866-8940-4e80-b8c5-60e11dacc8f1","Type":"ContainerDied","Data":"1035f5a6df72ef7f4559e9f4a7e5df101fb8f25dcb0d7ae21c260664cb49e0ee"} Jul 06 01:27:47.273411 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.273378 2571 generic.go:356] "Generic (PLEG): container finished" podID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerID="9e721c61174acdcb979c6f77d0aa6278afdc9a3ba1ecc424c608075499a11ba0" exitCode=0 Jul 06 01:27:47.273501 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.273404 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" event={"ID":"798d47b7-171b-4941-ac3c-dae21fc6ad70","Type":"ContainerDied","Data":"9e721c61174acdcb979c6f77d0aa6278afdc9a3ba1ecc424c608075499a11ba0"} Jul 06 01:27:47.273501 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.273441 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" event={"ID":"798d47b7-171b-4941-ac3c-dae21fc6ad70","Type":"ContainerStarted","Data":"39c437f7f950fcd4fe6cec90b5c49354db69876926cc39f66a291737cf343043"} Jul 06 01:27:47.323244 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.323220 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:47.487532 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:47.487509 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq"] Jul 06 01:27:47.489507 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:27:47.489481 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879d37c3_5e16_46f2_a595_6a878827c6e2.slice/crio-dc135754bed0877f1e72376fe9c74cd88deac04ec59fdf8d614896e936e5c206 WatchSource:0}: Error finding container dc135754bed0877f1e72376fe9c74cd88deac04ec59fdf8d614896e936e5c206: Status 404 returned error can't find the container with id dc135754bed0877f1e72376fe9c74cd88deac04ec59fdf8d614896e936e5c206 Jul 06 01:27:48.280138 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.280106 2571 generic.go:356] "Generic (PLEG): container finished" podID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerID="5839752ec2f15bd4a4627330fa9a8960473e7a106204e46f6d98a4b56e7e1277" exitCode=0 Jul 06 01:27:48.280547 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.280189 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" event={"ID":"80c44866-8940-4e80-b8c5-60e11dacc8f1","Type":"ContainerDied","Data":"5839752ec2f15bd4a4627330fa9a8960473e7a106204e46f6d98a4b56e7e1277"} Jul 06 01:27:48.281834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.281815 2571 generic.go:356] "Generic (PLEG): container finished" podID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerID="15abe561a5f805612df63a47c3ce5f607ca5e38941ba57034c2f84170f1cd494" exitCode=0 Jul 06 01:27:48.281997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.281905 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" event={"ID":"798d47b7-171b-4941-ac3c-dae21fc6ad70","Type":"ContainerDied","Data":"15abe561a5f805612df63a47c3ce5f607ca5e38941ba57034c2f84170f1cd494"} Jul 06 01:27:48.283878 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.283857 2571 generic.go:356] "Generic (PLEG): container finished" podID="4d783263-7570-4e19-8ff7-b64f60542547" containerID="4b8b212b18276c14ae92732d02ce749e41ffafa82a58e80ce4d2844ebf7003cd" exitCode=0 Jul 06 01:27:48.283991 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.283938 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" event={"ID":"4d783263-7570-4e19-8ff7-b64f60542547","Type":"ContainerDied","Data":"4b8b212b18276c14ae92732d02ce749e41ffafa82a58e80ce4d2844ebf7003cd"} Jul 06 01:27:48.285367 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.285347 2571 generic.go:356] "Generic (PLEG): container finished" podID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerID="c8ed83b3a5948b6f932bc72e2e5328ba4b3eb01496e163f8a1c3b9a72f084f72" exitCode=0 Jul 06 01:27:48.285447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.285372 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" event={"ID":"879d37c3-5e16-46f2-a595-6a878827c6e2","Type":"ContainerDied","Data":"c8ed83b3a5948b6f932bc72e2e5328ba4b3eb01496e163f8a1c3b9a72f084f72"} Jul 06 01:27:48.285447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:48.285406 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" event={"ID":"879d37c3-5e16-46f2-a595-6a878827c6e2","Type":"ContainerStarted","Data":"dc135754bed0877f1e72376fe9c74cd88deac04ec59fdf8d614896e936e5c206"} Jul 06 01:27:49.292008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.291889 2571 generic.go:356] "Generic (PLEG): container finished" podID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerID="9bcffabbd07842697b8689c5aef9964b232136ee5e2399b10119604594e217ae" exitCode=0 Jul 06 01:27:49.292008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.291979 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" event={"ID":"798d47b7-171b-4941-ac3c-dae21fc6ad70","Type":"ContainerDied","Data":"9bcffabbd07842697b8689c5aef9964b232136ee5e2399b10119604594e217ae"} Jul 06 01:27:49.294024 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.293996 2571 generic.go:356] "Generic (PLEG): container finished" podID="4d783263-7570-4e19-8ff7-b64f60542547" containerID="df32ef95c2014423ebd05bf5d6a408f2e3b66df644f71280ec9d5535c090a726" exitCode=0 Jul 06 01:27:49.294142 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.294076 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" event={"ID":"4d783263-7570-4e19-8ff7-b64f60542547","Type":"ContainerDied","Data":"df32ef95c2014423ebd05bf5d6a408f2e3b66df644f71280ec9d5535c090a726"} Jul 06 01:27:49.295889 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.295868 2571 generic.go:356] "Generic (PLEG): container finished" podID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerID="81f7ff6a9c68d107f4f64ceea0f0836816cb7992a2dde4372296a65d7abdaa34" exitCode=0 Jul 06 01:27:49.296033 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.295937 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" event={"ID":"879d37c3-5e16-46f2-a595-6a878827c6e2","Type":"ContainerDied","Data":"81f7ff6a9c68d107f4f64ceea0f0836816cb7992a2dde4372296a65d7abdaa34"} Jul 06 01:27:49.429924 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.429898 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:49.535518 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.535492 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc698\" (UniqueName: \"kubernetes.io/projected/80c44866-8940-4e80-b8c5-60e11dacc8f1-kube-api-access-cc698\") pod \"80c44866-8940-4e80-b8c5-60e11dacc8f1\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " Jul 06 01:27:49.535692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.535542 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-bundle\") pod \"80c44866-8940-4e80-b8c5-60e11dacc8f1\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " Jul 06 01:27:49.535692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.535566 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-util\") pod \"80c44866-8940-4e80-b8c5-60e11dacc8f1\" (UID: \"80c44866-8940-4e80-b8c5-60e11dacc8f1\") " Jul 06 01:27:49.536097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.536073 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-bundle" (OuterVolumeSpecName: "bundle") pod "80c44866-8940-4e80-b8c5-60e11dacc8f1" (UID: "80c44866-8940-4e80-b8c5-60e11dacc8f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:49.537657 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.537626 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c44866-8940-4e80-b8c5-60e11dacc8f1-kube-api-access-cc698" (OuterVolumeSpecName: "kube-api-access-cc698") pod "80c44866-8940-4e80-b8c5-60e11dacc8f1" (UID: "80c44866-8940-4e80-b8c5-60e11dacc8f1"). InnerVolumeSpecName "kube-api-access-cc698". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:27:49.542599 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.542551 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-util" (OuterVolumeSpecName: "util") pod "80c44866-8940-4e80-b8c5-60e11dacc8f1" (UID: "80c44866-8940-4e80-b8c5-60e11dacc8f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:49.636480 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.636446 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:49.636480 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.636474 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c44866-8940-4e80-b8c5-60e11dacc8f1-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:49.636480 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:49.636484 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc698\" (UniqueName: \"kubernetes.io/projected/80c44866-8940-4e80-b8c5-60e11dacc8f1-kube-api-access-cc698\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:50.302867 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.302832 2571 generic.go:356] "Generic (PLEG): container finished" podID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerID="d6eed4ef0c763291abc4a2bbf52d8370a298f56046e29740025b5c5403138507" exitCode=0 Jul 06 01:27:50.303331 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.302896 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" event={"ID":"879d37c3-5e16-46f2-a595-6a878827c6e2","Type":"ContainerDied","Data":"d6eed4ef0c763291abc4a2bbf52d8370a298f56046e29740025b5c5403138507"} Jul 06 01:27:50.304662 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.304643 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" Jul 06 01:27:50.304762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.304677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4" event={"ID":"80c44866-8940-4e80-b8c5-60e11dacc8f1","Type":"ContainerDied","Data":"5b3c0923dc2199161dc94b3e46b435cbb95a93e9b82c0498b9261dd1e573eadb"} Jul 06 01:27:50.304762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.304708 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b3c0923dc2199161dc94b3e46b435cbb95a93e9b82c0498b9261dd1e573eadb" Jul 06 01:27:50.436745 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.436721 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:50.468058 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.467975 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:50.543696 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.543665 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9s58\" (UniqueName: \"kubernetes.io/projected/798d47b7-171b-4941-ac3c-dae21fc6ad70-kube-api-access-r9s58\") pod \"798d47b7-171b-4941-ac3c-dae21fc6ad70\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " Jul 06 01:27:50.543861 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.543729 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-bundle\") pod \"798d47b7-171b-4941-ac3c-dae21fc6ad70\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " Jul 06 01:27:50.543861 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.543757 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqcns\" (UniqueName: \"kubernetes.io/projected/4d783263-7570-4e19-8ff7-b64f60542547-kube-api-access-gqcns\") pod \"4d783263-7570-4e19-8ff7-b64f60542547\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " Jul 06 01:27:50.543935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.543912 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-util\") pod \"798d47b7-171b-4941-ac3c-dae21fc6ad70\" (UID: \"798d47b7-171b-4941-ac3c-dae21fc6ad70\") " Jul 06 01:27:50.544010 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.543982 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-util\") pod \"4d783263-7570-4e19-8ff7-b64f60542547\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " Jul 06 01:27:50.544055 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.544032 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-bundle\") pod \"4d783263-7570-4e19-8ff7-b64f60542547\" (UID: \"4d783263-7570-4e19-8ff7-b64f60542547\") " Jul 06 01:27:50.544574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.544541 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-bundle" (OuterVolumeSpecName: "bundle") pod "798d47b7-171b-4941-ac3c-dae21fc6ad70" (UID: "798d47b7-171b-4941-ac3c-dae21fc6ad70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:50.544697 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.544590 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-bundle" (OuterVolumeSpecName: "bundle") pod "4d783263-7570-4e19-8ff7-b64f60542547" (UID: "4d783263-7570-4e19-8ff7-b64f60542547"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:50.545908 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.545889 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/798d47b7-171b-4941-ac3c-dae21fc6ad70-kube-api-access-r9s58" (OuterVolumeSpecName: "kube-api-access-r9s58") pod "798d47b7-171b-4941-ac3c-dae21fc6ad70" (UID: "798d47b7-171b-4941-ac3c-dae21fc6ad70"). InnerVolumeSpecName "kube-api-access-r9s58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:27:50.546153 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.546138 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d783263-7570-4e19-8ff7-b64f60542547-kube-api-access-gqcns" (OuterVolumeSpecName: "kube-api-access-gqcns") pod "4d783263-7570-4e19-8ff7-b64f60542547" (UID: "4d783263-7570-4e19-8ff7-b64f60542547"). InnerVolumeSpecName "kube-api-access-gqcns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:27:50.550279 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.550260 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-util" (OuterVolumeSpecName: "util") pod "798d47b7-171b-4941-ac3c-dae21fc6ad70" (UID: "798d47b7-171b-4941-ac3c-dae21fc6ad70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:50.551393 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.551369 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-util" (OuterVolumeSpecName: "util") pod "4d783263-7570-4e19-8ff7-b64f60542547" (UID: "4d783263-7570-4e19-8ff7-b64f60542547"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:50.644935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.644858 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqcns\" (UniqueName: \"kubernetes.io/projected/4d783263-7570-4e19-8ff7-b64f60542547-kube-api-access-gqcns\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:50.644935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.644886 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:50.644935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.644899 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:50.644935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.644910 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d783263-7570-4e19-8ff7-b64f60542547-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:50.644935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.644921 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9s58\" (UniqueName: \"kubernetes.io/projected/798d47b7-171b-4941-ac3c-dae21fc6ad70-kube-api-access-r9s58\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:50.644935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:50.644933 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/798d47b7-171b-4941-ac3c-dae21fc6ad70-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:51.316034 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.316009 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" Jul 06 01:27:51.316034 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.316021 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd" event={"ID":"798d47b7-171b-4941-ac3c-dae21fc6ad70","Type":"ContainerDied","Data":"39c437f7f950fcd4fe6cec90b5c49354db69876926cc39f66a291737cf343043"} Jul 06 01:27:51.316491 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.316085 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39c437f7f950fcd4fe6cec90b5c49354db69876926cc39f66a291737cf343043" Jul 06 01:27:51.318188 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.318169 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" Jul 06 01:27:51.318309 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.318215 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k" event={"ID":"4d783263-7570-4e19-8ff7-b64f60542547","Type":"ContainerDied","Data":"553ec0deb18c50939632afb171d518bca12749c060e53e715497244b3420b60c"} Jul 06 01:27:51.318309 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.318252 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="553ec0deb18c50939632afb171d518bca12749c060e53e715497244b3420b60c" Jul 06 01:27:51.445255 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.445233 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:51.552684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.552599 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-bundle\") pod \"879d37c3-5e16-46f2-a595-6a878827c6e2\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " Jul 06 01:27:51.552684 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.552652 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-util\") pod \"879d37c3-5e16-46f2-a595-6a878827c6e2\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " Jul 06 01:27:51.552895 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.552718 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c67sj\" (UniqueName: \"kubernetes.io/projected/879d37c3-5e16-46f2-a595-6a878827c6e2-kube-api-access-c67sj\") pod \"879d37c3-5e16-46f2-a595-6a878827c6e2\" (UID: \"879d37c3-5e16-46f2-a595-6a878827c6e2\") " Jul 06 01:27:51.553173 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.553145 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-bundle" (OuterVolumeSpecName: "bundle") pod "879d37c3-5e16-46f2-a595-6a878827c6e2" (UID: "879d37c3-5e16-46f2-a595-6a878827c6e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:51.554703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.554676 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879d37c3-5e16-46f2-a595-6a878827c6e2-kube-api-access-c67sj" (OuterVolumeSpecName: "kube-api-access-c67sj") pod "879d37c3-5e16-46f2-a595-6a878827c6e2" (UID: "879d37c3-5e16-46f2-a595-6a878827c6e2"). InnerVolumeSpecName "kube-api-access-c67sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:27:51.557546 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.557523 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-util" (OuterVolumeSpecName: "util") pod "879d37c3-5e16-46f2-a595-6a878827c6e2" (UID: "879d37c3-5e16-46f2-a595-6a878827c6e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:27:51.654231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.654198 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:51.654231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.654231 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/879d37c3-5e16-46f2-a595-6a878827c6e2-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:51.654231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:51.654241 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c67sj\" (UniqueName: \"kubernetes.io/projected/879d37c3-5e16-46f2-a595-6a878827c6e2-kube-api-access-c67sj\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:27:52.324640 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:52.324605 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" event={"ID":"879d37c3-5e16-46f2-a595-6a878827c6e2","Type":"ContainerDied","Data":"dc135754bed0877f1e72376fe9c74cd88deac04ec59fdf8d614896e936e5c206"} Jul 06 01:27:52.325035 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:52.324651 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq" Jul 06 01:27:52.325035 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:52.324657 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc135754bed0877f1e72376fe9c74cd88deac04ec59fdf8d614896e936e5c206" Jul 06 01:27:59.116120 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:27:59.116071 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:00.371118 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:00.371078 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:00.423318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:00.423283 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:00.490419 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:00.490369 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:02.329570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:02.329527 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:03.241250 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:03.241214 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:03.701771 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:03.701737 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:03.801427 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:03.801389 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:03.923068 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:03.923037 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:04.443653 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:04.443619 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:04.544553 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:04.544512 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:05.714235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:05.714201 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:05.858619 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:05.858583 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:07.080850 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:07.080811 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:10.246446 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:10.246402 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:10.637311 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:10.637211 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:10.941014 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:10.940979 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:11.039290 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:11.039246 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:13.693295 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:13.693255 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:14.701789 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:14.701755 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f658d5cc7-stb5z"] Jul 06 01:28:14.805158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:14.805120 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:14.902966 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:14.902907 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:14.956224 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:14.956143 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:15.047001 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:15.046967 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:15.148693 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:15.148661 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:18.854591 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:18.854562 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:18.955442 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:18.955405 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:19.366655 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:19.366620 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:19.645086 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:19.644995 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:21.064830 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:21.064788 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:21.156172 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:21.156139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:22.251262 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:22.251227 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:22.348095 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:22.348059 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:32.060616 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:32.060574 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:32.160579 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:32.160542 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:32.641270 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:32.641236 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:32.746150 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:32.746113 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:37.642714 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:37.642681 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:37.744311 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:37.744275 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:39.724612 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:39.724568 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f658d5cc7-stb5z" podUID="1201ab3d-528e-4620-91ca-f47e5b2879dd" containerName="console" containerID="cri-o://6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb" gracePeriod=15 Jul 06 01:28:39.965107 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:39.965078 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:28:40.091481 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091402 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-serving-cert\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.091481 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091440 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-trusted-ca-bundle\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.091481 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091468 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-config\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.091763 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091507 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-oauth-config\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.091763 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091562 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-service-ca\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.091763 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091605 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpgln\" (UniqueName: \"kubernetes.io/projected/1201ab3d-528e-4620-91ca-f47e5b2879dd-kube-api-access-gpgln\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.091763 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091646 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-oauth-serving-cert\") pod \"1201ab3d-528e-4620-91ca-f47e5b2879dd\" (UID: \"1201ab3d-528e-4620-91ca-f47e5b2879dd\") " Jul 06 01:28:40.092025 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.091981 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:28:40.092143 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.092074 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:28:40.092143 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.092113 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:28:40.092214 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.092195 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-config" (OuterVolumeSpecName: "console-config") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:28:40.093734 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.093708 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1201ab3d-528e-4620-91ca-f47e5b2879dd-kube-api-access-gpgln" (OuterVolumeSpecName: "kube-api-access-gpgln") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "kube-api-access-gpgln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:28:40.094154 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.094128 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:28:40.094215 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.094145 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1201ab3d-528e-4620-91ca-f47e5b2879dd" (UID: "1201ab3d-528e-4620-91ca-f47e5b2879dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:28:40.192986 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.192928 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.192986 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.192976 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.192986 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.192986 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.192986 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.192996 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1201ab3d-528e-4620-91ca-f47e5b2879dd-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.193240 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.193004 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.193240 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.193012 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpgln\" (UniqueName: \"kubernetes.io/projected/1201ab3d-528e-4620-91ca-f47e5b2879dd-kube-api-access-gpgln\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.193240 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.193021 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1201ab3d-528e-4620-91ca-f47e5b2879dd-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:28:40.554927 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.554892 2571 generic.go:356] "Generic (PLEG): container finished" podID="1201ab3d-528e-4620-91ca-f47e5b2879dd" containerID="6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb" exitCode=0 Jul 06 01:28:40.555131 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.554931 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f658d5cc7-stb5z" Jul 06 01:28:40.555131 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.554966 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f658d5cc7-stb5z" event={"ID":"1201ab3d-528e-4620-91ca-f47e5b2879dd","Type":"ContainerDied","Data":"6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb"} Jul 06 01:28:40.555131 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.555017 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f658d5cc7-stb5z" event={"ID":"1201ab3d-528e-4620-91ca-f47e5b2879dd","Type":"ContainerDied","Data":"3edd8c8d12114c91704e8ab0d4997f593a17d30d0277025d5817d97340b35072"} Jul 06 01:28:40.555131 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.555045 2571 scope.go:117] "RemoveContainer" containerID="6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb" Jul 06 01:28:40.564931 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.564912 2571 scope.go:117] "RemoveContainer" containerID="6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb" Jul 06 01:28:40.565201 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:28:40.565179 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb\": container with ID starting with 6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb not found: ID does not exist" containerID="6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb" Jul 06 01:28:40.565254 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.565209 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb"} err="failed to get container status \"6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb\": rpc error: code = NotFound desc = could not find container \"6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb\": container with ID starting with 6ac086c8049ea1e63b50666044e9903aece6471ee78edc920d469f8ea0c1cbeb not found: ID does not exist" Jul 06 01:28:40.577703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.577680 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f658d5cc7-stb5z"] Jul 06 01:28:40.585094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:40.585073 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f658d5cc7-stb5z"] Jul 06 01:28:41.038924 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:41.038885 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:41.140111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:41.140072 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:41.271469 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:41.271438 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1201ab3d-528e-4620-91ca-f47e5b2879dd" path="/var/lib/kubelet/pods/1201ab3d-528e-4620-91ca-f47e5b2879dd/volumes" Jul 06 01:28:44.442694 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:44.442663 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:44.497170 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:44.497126 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:53.455670 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:53.455631 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:53.553418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:53.553382 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:56.064181 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:56.064134 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:56.166805 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:56.166764 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.252219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:59.252170 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.353385 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:28:59.353348 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:02.856655 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:02.856570 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:02.922419 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:02.922384 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:10.186179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186142 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4"] Jul 06 01:29:10.186607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186593 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="util" Jul 06 01:29:10.186649 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186610 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="util" Jul 06 01:29:10.186649 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186623 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="util" Jul 06 01:29:10.186649 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186631 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="util" Jul 06 01:29:10.186649 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186640 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="pull" Jul 06 01:29:10.186649 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186648 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="pull" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186657 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="extract" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186682 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="extract" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186698 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="util" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186706 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="util" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186719 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="extract" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186728 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="extract" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186738 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="util" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186746 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="util" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186758 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="pull" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186766 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="pull" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186774 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="pull" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186782 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="pull" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186792 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1201ab3d-528e-4620-91ca-f47e5b2879dd" containerName="console" Jul 06 01:29:10.186802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186800 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1201ab3d-528e-4620-91ca-f47e5b2879dd" containerName="console" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186809 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186817 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186826 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="pull" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186833 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="pull" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186847 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186855 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186929 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c44866-8940-4e80-b8c5-60e11dacc8f1" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186939 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="798d47b7-171b-4941-ac3c-dae21fc6ad70" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186966 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1201ab3d-528e-4620-91ca-f47e5b2879dd" containerName="console" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186976 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="879d37c3-5e16-46f2-a595-6a878827c6e2" containerName="extract" Jul 06 01:29:10.187235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.186985 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d783263-7570-4e19-8ff7-b64f60542547" containerName="extract" Jul 06 01:29:10.190497 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.190471 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.191086 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.191046 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4"] Jul 06 01:29:10.192756 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.192713 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q4cwq\"" Jul 06 01:29:10.197829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.197785 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:10.245742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245707 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245744 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245795 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245826 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ndr\" (UniqueName: \"kubernetes.io/projected/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-kube-api-access-54ndr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245856 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245879 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.245978 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.245928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.346933 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.346897 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.346936 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.346998 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347180 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347349 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347284 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347349 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347323 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347349 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347345 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347502 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347382 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347502 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347428 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347502 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347480 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ndr\" (UniqueName: \"kubernetes.io/projected/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-kube-api-access-54ndr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347748 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347721 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.347889 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.347852 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.348157 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.348129 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.348226 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.348166 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.350069 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.350046 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.350171 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.350153 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.355174 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.355153 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.355308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.355292 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ndr\" (UniqueName: \"kubernetes.io/projected/57e4c71c-d285-47ec-a6c3-84062fdfc9f8-kube-api-access-54ndr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58rf4\" (UID: \"57e4c71c-d285-47ec-a6c3-84062fdfc9f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.503049 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.502967 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:10.515925 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.515892 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:10.640703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.640680 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4"] Jul 06 01:29:10.642881 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:29:10.642855 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e4c71c_d285_47ec_a6c3_84062fdfc9f8.slice/crio-03bbe982dc311ee113f8fb9f59270b680391c3ae7f31ca96c4b6e9265d4ff8b8 WatchSource:0}: Error finding container 03bbe982dc311ee113f8fb9f59270b680391c3ae7f31ca96c4b6e9265d4ff8b8: Status 404 returned error can't find the container with id 03bbe982dc311ee113f8fb9f59270b680391c3ae7f31ca96c4b6e9265d4ff8b8 Jul 06 01:29:10.645314 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.645283 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:29:10.645401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.645348 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:29:10.645401 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.645381 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:29:10.701451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:10.701416 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" event={"ID":"57e4c71c-d285-47ec-a6c3-84062fdfc9f8","Type":"ContainerStarted","Data":"03bbe982dc311ee113f8fb9f59270b680391c3ae7f31ca96c4b6e9265d4ff8b8"} Jul 06 01:29:11.707908 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:11.707871 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" event={"ID":"57e4c71c-d285-47ec-a6c3-84062fdfc9f8","Type":"ContainerStarted","Data":"f0d15866362725c6f6ef7cf721797ff12e65e40a6dea161854b0060609663405"} Jul 06 01:29:11.729267 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:11.729216 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" podStartSLOduration=1.729200322 podStartE2EDuration="1.729200322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:29:11.726121529 +0000 UTC m=+543.148924585" watchObservedRunningTime="2026-07-06 01:29:11.729200322 +0000 UTC m=+543.152003397" Jul 06 01:29:11.877742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:11.877708 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:11.975152 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:11.975068 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:12.503496 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:12.503454 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:12.508301 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:12.508276 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:12.713559 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:12.713527 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:12.714535 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:12.714517 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:29:15.222344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:15.222313 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:15.379239 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:15.379209 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:15.470079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:15.470043 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:16.068710 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:16.068675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:16.133914 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:16.133878 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:34.410167 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:34.410119 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:47.426224 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:47.426186 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:47.561699 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:47.561655 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:54.575624 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:54.575584 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:54.653350 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:54.653308 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:54.714688 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:54.714655 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:57.389813 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:57.389778 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:57.497244 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:29:57.497200 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:07.217074 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:07.217037 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:09.026829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:09.026800 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:30:09.030053 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:09.030028 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:30:21.257938 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:21.257896 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:28.408344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:28.408300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:28.896350 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:28.896312 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:29.175375 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.175339 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:29.455848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.455748 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:29.551226 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.551185 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:29.569764 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.569734 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2tjjf"] Jul 06 01:30:29.572869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.572849 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.575141 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.575122 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 01:30:29.575912 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.575897 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-q8wzf\"" Jul 06 01:30:29.583789 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.583764 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2tjjf"] Jul 06 01:30:29.634429 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.634399 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa6daad-1ab3-4012-b6b7-309ed5446513-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2tjjf\" (UID: \"bfa6daad-1ab3-4012-b6b7-309ed5446513\") " pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.634584 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.634437 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vrfv\" (UniqueName: \"kubernetes.io/projected/bfa6daad-1ab3-4012-b6b7-309ed5446513-kube-api-access-2vrfv\") pod \"payload-pre-processing-7964457696-2tjjf\" (UID: \"bfa6daad-1ab3-4012-b6b7-309ed5446513\") " pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.735988 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.735873 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrfv\" (UniqueName: \"kubernetes.io/projected/bfa6daad-1ab3-4012-b6b7-309ed5446513-kube-api-access-2vrfv\") pod \"payload-pre-processing-7964457696-2tjjf\" (UID: \"bfa6daad-1ab3-4012-b6b7-309ed5446513\") " pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.736149 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.736042 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa6daad-1ab3-4012-b6b7-309ed5446513-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2tjjf\" (UID: \"bfa6daad-1ab3-4012-b6b7-309ed5446513\") " pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.736928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.736901 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa6daad-1ab3-4012-b6b7-309ed5446513-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2tjjf\" (UID: \"bfa6daad-1ab3-4012-b6b7-309ed5446513\") " pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.746668 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.746644 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vrfv\" (UniqueName: \"kubernetes.io/projected/bfa6daad-1ab3-4012-b6b7-309ed5446513-kube-api-access-2vrfv\") pod \"payload-pre-processing-7964457696-2tjjf\" (UID: \"bfa6daad-1ab3-4012-b6b7-309ed5446513\") " pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:29.884965 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:29.884909 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:30.015009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:30.014982 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2tjjf"] Jul 06 01:30:30.016285 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:30:30.016259 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa6daad_1ab3_4012_b6b7_309ed5446513.slice/crio-666a35a4824e2f36b017a1b7360acfe7230daddf89f19f7842622eed0007b717 WatchSource:0}: Error finding container 666a35a4824e2f36b017a1b7360acfe7230daddf89f19f7842622eed0007b717: Status 404 returned error can't find the container with id 666a35a4824e2f36b017a1b7360acfe7230daddf89f19f7842622eed0007b717 Jul 06 01:30:30.018182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:30.018165 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:30:30.092497 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:30.092462 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" event={"ID":"bfa6daad-1ab3-4012-b6b7-309ed5446513","Type":"ContainerStarted","Data":"666a35a4824e2f36b017a1b7360acfe7230daddf89f19f7842622eed0007b717"} Jul 06 01:30:32.104251 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:32.104212 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" event={"ID":"bfa6daad-1ab3-4012-b6b7-309ed5446513","Type":"ContainerStarted","Data":"c4a2454d574397d967c6b4e9c5a38f2d5e9148e4e030bea9dd30a77d29e780f4"} Jul 06 01:30:32.104730 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:32.104279 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:32.122737 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:32.122690 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" podStartSLOduration=1.6479950049999998 podStartE2EDuration="3.122675813s" totalImagesPullingTime="1.474680808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:32.119939771 +0000 UTC m=+623.542742857" watchObservedRunningTime="2026-07-06 01:30:32.122675813 +0000 UTC m=+623.545478868" Jul 06 01:30:37.131247 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:37.131212 2571 generic.go:356] "Generic (PLEG): container finished" podID="57e4c71c-d285-47ec-a6c3-84062fdfc9f8" containerID="f0d15866362725c6f6ef7cf721797ff12e65e40a6dea161854b0060609663405" exitCode=0 Jul 06 01:30:37.131247 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:37.131251 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" event={"ID":"57e4c71c-d285-47ec-a6c3-84062fdfc9f8","Type":"ContainerDied","Data":"f0d15866362725c6f6ef7cf721797ff12e65e40a6dea161854b0060609663405"} Jul 06 01:30:37.131776 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:37.131603 2571 scope.go:117] "RemoveContainer" containerID="f0d15866362725c6f6ef7cf721797ff12e65e40a6dea161854b0060609663405" Jul 06 01:30:37.132595 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:37.132565 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:30:37.132656 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:37.132637 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:30:37.132692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:37.132669 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:30:38.141663 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:38.141626 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" event={"ID":"57e4c71c-d285-47ec-a6c3-84062fdfc9f8","Type":"ContainerStarted","Data":"c5c30d8c44c837761e6aac581d61c3df269698790058a1767ad1fd3793696437"} Jul 06 01:30:38.338627 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:38.338595 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:38.435515 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:38.435475 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:38.503820 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:38.503779 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:30:38.504917 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:38.504892 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58rf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 01:30:38.504998 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:38.504957 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" podUID="57e4c71c-d285-47ec-a6c3-84062fdfc9f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 01:30:39.503675 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:39.503637 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58rf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 01:30:39.504134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:39.503694 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" podUID="57e4c71c-d285-47ec-a6c3-84062fdfc9f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 01:30:40.503773 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:40.503732 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58rf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 01:30:40.504316 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:40.503803 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" podUID="57e4c71c-d285-47ec-a6c3-84062fdfc9f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 01:30:41.503570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:41.503531 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58rf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 01:30:41.503751 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:41.503585 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" podUID="57e4c71c-d285-47ec-a6c3-84062fdfc9f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 01:30:42.507729 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:42.507698 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:30:42.508128 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:42.507986 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:30:42.508766 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:42.508746 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58rf4" Jul 06 01:30:43.114131 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:43.114094 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-2tjjf" Jul 06 01:30:48.550277 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.550242 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f"] Jul 06 01:30:48.556932 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.556906 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.559771 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.559741 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 01:30:48.559771 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.559772 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2mpd\"" Jul 06 01:30:48.560071 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.560054 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 01:30:48.560521 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.560494 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 01:30:48.562400 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.562373 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f"] Jul 06 01:30:48.582338 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.582271 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:48.607404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.607369 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.607533 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.607479 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.607533 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.607512 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.607610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.607538 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a3f6381-6f68-40ee-b712-a3929d775764-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.607610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.607561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.607610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.607583 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfp7\" (UniqueName: \"kubernetes.io/projected/8a3f6381-6f68-40ee-b712-a3929d775764-kube-api-access-5wfp7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708229 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708187 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfp7\" (UniqueName: \"kubernetes.io/projected/8a3f6381-6f68-40ee-b712-a3929d775764-kube-api-access-5wfp7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708408 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708408 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708358 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708408 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708386 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708408 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708403 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a3f6381-6f68-40ee-b712-a3929d775764-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708580 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708435 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708704 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708791 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708771 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.708829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.708805 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.710716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.710686 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a3f6381-6f68-40ee-b712-a3929d775764-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.711011 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.710990 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a3f6381-6f68-40ee-b712-a3929d775764-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.715832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.715810 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfp7\" (UniqueName: \"kubernetes.io/projected/8a3f6381-6f68-40ee-b712-a3929d775764-kube-api-access-5wfp7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f\" (UID: \"8a3f6381-6f68-40ee-b712-a3929d775764\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:48.869144 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:48.869038 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:49.006066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:49.006040 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f"] Jul 06 01:30:49.008118 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:30:49.008087 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3f6381_6f68_40ee_b712_a3929d775764.slice/crio-7c6b2c1d64d2496d8646b82266d0836c07aeeee7325eee41846602ceeef54c98 WatchSource:0}: Error finding container 7c6b2c1d64d2496d8646b82266d0836c07aeeee7325eee41846602ceeef54c98: Status 404 returned error can't find the container with id 7c6b2c1d64d2496d8646b82266d0836c07aeeee7325eee41846602ceeef54c98 Jul 06 01:30:49.200601 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:49.200564 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" event={"ID":"8a3f6381-6f68-40ee-b712-a3929d775764","Type":"ContainerStarted","Data":"7c6b2c1d64d2496d8646b82266d0836c07aeeee7325eee41846602ceeef54c98"} Jul 06 01:30:51.213598 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:51.213561 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" event={"ID":"8a3f6381-6f68-40ee-b712-a3929d775764","Type":"ContainerStarted","Data":"e2522358ad3c9ef16642d993b3cc08c0851812bb2bc40ca6e562f0686d4a7b8b"} Jul 06 01:30:51.230292 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:51.230226 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" podStartSLOduration=2.077365115 podStartE2EDuration="3.230207962s" totalImagesPullingTime="1.152842847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:51.229982677 +0000 UTC m=+642.652785733" watchObservedRunningTime="2026-07-06 01:30:51.230207962 +0000 UTC m=+642.653011020" Jul 06 01:30:55.393656 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:55.393614 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:55.453024 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:55.452986 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:58.869861 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:58.869794 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:58.870298 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:58.869909 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:58.882602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:58.882575 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:30:59.272754 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:30:59.272725 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f" Jul 06 01:31:08.761519 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.761482 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h"] Jul 06 01:31:08.765997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.765977 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.768278 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.768256 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 01:31:08.774537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.774519 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h"] Jul 06 01:31:08.803961 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.803917 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:08.885873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.885843 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.886072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.885880 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.886072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.885987 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84knk\" (UniqueName: \"kubernetes.io/projected/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-kube-api-access-84knk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.886072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.886029 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.886183 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.886082 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.886183 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.886106 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987393 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987356 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84knk\" (UniqueName: \"kubernetes.io/projected/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-kube-api-access-84knk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987580 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987402 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987580 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987433 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987580 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987454 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987580 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987482 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987580 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987508 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.987899 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987874 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.988010 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987898 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.988010 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.987995 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.989663 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.989633 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.989751 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.989736 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 01:31:08.995240 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.995219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84knk\" (UniqueName: \"kubernetes.io/projected/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-kube-api-access-84knk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:08.999721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:08.999700 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29acbdc1-a3f4-44b7-9118-26e8ff6d3d50-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-h9n4h\" (UID: \"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:09.078169 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:09.078084 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:09.206740 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:09.206711 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h"] Jul 06 01:31:09.207560 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:31:09.207533 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29acbdc1_a3f4_44b7_9118_26e8ff6d3d50.slice/crio-f7b0837773eaf9cd625535987de51dbfbc62a6cdf06f37ea6595b344dcacc479 WatchSource:0}: Error finding container f7b0837773eaf9cd625535987de51dbfbc62a6cdf06f37ea6595b344dcacc479: Status 404 returned error can't find the container with id f7b0837773eaf9cd625535987de51dbfbc62a6cdf06f37ea6595b344dcacc479 Jul 06 01:31:09.302353 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:09.302319 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" event={"ID":"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50","Type":"ContainerStarted","Data":"f7b0837773eaf9cd625535987de51dbfbc62a6cdf06f37ea6595b344dcacc479"} Jul 06 01:31:10.308785 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:10.308742 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" event={"ID":"29acbdc1-a3f4-44b7-9118-26e8ff6d3d50","Type":"ContainerStarted","Data":"64f92173ec5ec72cbcda34fc54e225fe31f641345b4b40459edaec1dd71e60f6"} Jul 06 01:31:10.324721 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:10.324671 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" podStartSLOduration=2.137650091 podStartE2EDuration="2.324655369s" totalImagesPullingTime="187.005278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:10.324097975 +0000 UTC m=+661.746901030" watchObservedRunningTime="2026-07-06 01:31:10.324655369 +0000 UTC m=+661.747458424" Jul 06 01:31:13.083996 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:13.083931 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:16.594733 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:16.594692 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:19.078488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:19.078449 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:19.078881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:19.078528 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:19.090900 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:19.090875 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:19.366305 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:19.366221 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-h9n4h" Jul 06 01:31:29.904848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:29.904811 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:42.588297 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:31:42.588258 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:17.321100 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:32:17.321058 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:17.429264 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:32:17.429227 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:18.461398 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:32:18.461360 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:18.559507 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:32:18.559470 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:04.179286 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:33:04.179248 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:28.762547 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:33:28.762509 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:29.951420 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:33:29.951356 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:04.779747 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:04.779711 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:04.831333 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:04.831296 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:08.409885 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:08.409844 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:08.511710 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:08.511678 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:08.612273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:08.612237 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:14.444203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:14.444169 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:14.545321 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:14.545289 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:14.644599 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:14.644555 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:14.784586 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:14.784490 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:20.378690 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:20.378647 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:20.479288 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:34:20.479250 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:05.531778 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:35:05.531688 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:09.061140 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:35:09.061113 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:35:09.061605 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:35:09.061158 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:35:50.113969 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:35:50.113911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:12.311012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:37:12.310971 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:12.411637 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:37:12.411583 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:40:09.093868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:40:09.093789 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:40:09.094483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:40:09.094465 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:41:06.687857 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:41:06.687767 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:07.992129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:41:07.992095 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:35.476692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:41:35.476655 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:40.065104 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:41:40.065065 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:12.851330 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:43:12.851283 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:44:56.738481 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:44:56.738447 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:00.142497 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.142464 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721705-l7zkp"] Jul 06 01:45:00.145749 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.145733 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:00.147938 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.147918 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rhllt\"" Jul 06 01:45:00.161059 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.161032 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721705-l7zkp"] Jul 06 01:45:00.226215 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.226166 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqwvp\" (UniqueName: \"kubernetes.io/projected/a629ae47-8473-4c52-8ebb-d93268921a19-kube-api-access-fqwvp\") pod \"maas-api-key-cleanup-29721705-l7zkp\" (UID: \"a629ae47-8473-4c52-8ebb-d93268921a19\") " pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:00.327750 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.327707 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqwvp\" (UniqueName: \"kubernetes.io/projected/a629ae47-8473-4c52-8ebb-d93268921a19-kube-api-access-fqwvp\") pod \"maas-api-key-cleanup-29721705-l7zkp\" (UID: \"a629ae47-8473-4c52-8ebb-d93268921a19\") " pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:00.335564 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.335534 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqwvp\" (UniqueName: \"kubernetes.io/projected/a629ae47-8473-4c52-8ebb-d93268921a19-kube-api-access-fqwvp\") pod \"maas-api-key-cleanup-29721705-l7zkp\" (UID: \"a629ae47-8473-4c52-8ebb-d93268921a19\") " pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:00.455866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.455834 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:00.797979 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.797924 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721705-l7zkp"] Jul 06 01:45:00.799651 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:45:00.799626 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda629ae47_8473_4c52_8ebb_d93268921a19.slice/crio-4db4b0f32c7b67c072c29d234563079aa7604d51dc830b09dc1c81a5965edc13 WatchSource:0}: Error finding container 4db4b0f32c7b67c072c29d234563079aa7604d51dc830b09dc1c81a5965edc13: Status 404 returned error can't find the container with id 4db4b0f32c7b67c072c29d234563079aa7604d51dc830b09dc1c81a5965edc13 Jul 06 01:45:00.801779 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:00.801764 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:45:01.449630 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:01.449591 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" event={"ID":"a629ae47-8473-4c52-8ebb-d93268921a19","Type":"ContainerStarted","Data":"4db4b0f32c7b67c072c29d234563079aa7604d51dc830b09dc1c81a5965edc13"} Jul 06 01:45:04.466648 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:04.466611 2571 generic.go:356] "Generic (PLEG): container finished" podID="a629ae47-8473-4c52-8ebb-d93268921a19" containerID="9c89222f109cf1f36f77653c5298f76f47a2010d264284e46c611d6ca8080048" exitCode=0 Jul 06 01:45:04.467052 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:04.466695 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" event={"ID":"a629ae47-8473-4c52-8ebb-d93268921a19","Type":"ContainerDied","Data":"9c89222f109cf1f36f77653c5298f76f47a2010d264284e46c611d6ca8080048"} Jul 06 01:45:05.606903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:05.606878 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:05.779656 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:05.779554 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqwvp\" (UniqueName: \"kubernetes.io/projected/a629ae47-8473-4c52-8ebb-d93268921a19-kube-api-access-fqwvp\") pod \"a629ae47-8473-4c52-8ebb-d93268921a19\" (UID: \"a629ae47-8473-4c52-8ebb-d93268921a19\") " Jul 06 01:45:05.781866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:05.781842 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a629ae47-8473-4c52-8ebb-d93268921a19-kube-api-access-fqwvp" (OuterVolumeSpecName: "kube-api-access-fqwvp") pod "a629ae47-8473-4c52-8ebb-d93268921a19" (UID: "a629ae47-8473-4c52-8ebb-d93268921a19"). InnerVolumeSpecName "kube-api-access-fqwvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:45:05.880588 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:05.880548 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqwvp\" (UniqueName: \"kubernetes.io/projected/a629ae47-8473-4c52-8ebb-d93268921a19-kube-api-access-fqwvp\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:06.477109 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:06.477077 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" Jul 06 01:45:06.477109 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:06.477096 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-l7zkp" event={"ID":"a629ae47-8473-4c52-8ebb-d93268921a19","Type":"ContainerDied","Data":"4db4b0f32c7b67c072c29d234563079aa7604d51dc830b09dc1c81a5965edc13"} Jul 06 01:45:06.477376 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:06.477141 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4db4b0f32c7b67c072c29d234563079aa7604d51dc830b09dc1c81a5965edc13" Jul 06 01:45:09.126685 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:09.126657 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:45:09.128686 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:09.128661 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:45:09.567359 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:09.567325 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:17.897487 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:17.897451 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:23.017066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:23.017032 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:25.912730 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:25.912696 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:26.012673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:26.012634 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:26.367686 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:26.367607 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:32.174712 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.174626 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:32.275076 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.275040 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:32.362176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.362143 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6"] Jul 06 01:45:32.362790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.362762 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629ae47-8473-4c52-8ebb-d93268921a19" containerName="cleanup" Jul 06 01:45:32.362790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.362788 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629ae47-8473-4c52-8ebb-d93268921a19" containerName="cleanup" Jul 06 01:45:32.363014 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.362887 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a629ae47-8473-4c52-8ebb-d93268921a19" containerName="cleanup" Jul 06 01:45:32.366192 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.366173 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.369209 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.369189 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-836a1b7b-openshift-default-dockercfg-6xpv6\"" Jul 06 01:45:32.395298 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.395260 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6"] Jul 06 01:45:32.415898 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.415868 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-podinfo\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.415909 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-certs\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.415937 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istiod-ca-cert\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.416032 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-data\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.416072 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-socket\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.416108 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-token\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.416137 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-credential-socket\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.416155 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-envoy\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.416248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.416212 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdz2r\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-kube-api-access-zdz2r\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.460680 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.460611 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:32.517023 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.516997 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istiod-ca-cert\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517187 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517037 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-data\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517187 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517068 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-socket\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517187 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517096 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-token\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517187 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517130 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-credential-socket\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517187 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517147 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-envoy\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517187 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517187 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdz2r\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-kube-api-access-zdz2r\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517230 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-podinfo\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517266 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-certs\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-data\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517553 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-socket\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517586 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-certs\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517628 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517614 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-credential-socket\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.517838 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.517755 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istiod-ca-cert\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.519758 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.519732 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-envoy\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.520009 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.519975 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-podinfo\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.534357 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.534336 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdz2r\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-kube-api-access-zdz2r\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.534462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.534339 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-token\") pod \"e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.563451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.563401 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:32.677056 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.677030 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:32.815727 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.815340 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6"] Jul 06 01:45:32.817627 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:45:32.817594 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3028f5f_7db5_49d8_a6ef_313f9402d2bd.slice/crio-9938d9efb09666c3fad56f1ef744b8d43cf46b2b0eadc1c39cd9d0c400aaddd2 WatchSource:0}: Error finding container 9938d9efb09666c3fad56f1ef744b8d43cf46b2b0eadc1c39cd9d0c400aaddd2: Status 404 returned error can't find the container with id 9938d9efb09666c3fad56f1ef744b8d43cf46b2b0eadc1c39cd9d0c400aaddd2 Jul 06 01:45:32.819673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.819644 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:32.819760 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.819711 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:32.819760 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:32.819741 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:33.522005 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.521965 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:33.613510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.613472 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" event={"ID":"d3028f5f-7db5-49d8-a6ef-313f9402d2bd","Type":"ContainerStarted","Data":"338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a"} Jul 06 01:45:33.613715 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.613528 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" event={"ID":"d3028f5f-7db5-49d8-a6ef-313f9402d2bd","Type":"ContainerStarted","Data":"9938d9efb09666c3fad56f1ef744b8d43cf46b2b0eadc1c39cd9d0c400aaddd2"} Jul 06 01:45:33.618377 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.618354 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:33.636452 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.636403 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" podStartSLOduration=1.636387067 podStartE2EDuration="1.636387067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:45:33.634592394 +0000 UTC m=+1525.057395450" watchObservedRunningTime="2026-07-06 01:45:33.636387067 +0000 UTC m=+1525.059190122" Jul 06 01:45:33.677893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.677858 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:33.683105 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.683079 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:33.752936 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:33.752901 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:34.107050 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:34.107012 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:34.207526 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:34.207498 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:34.308702 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:34.308666 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:34.619156 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:34.619128 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:34.620066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:34.620046 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:36.001458 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:36.001398 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:38.629353 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:38.629323 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:38.798439 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:38.798400 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6"] Jul 06 01:45:38.798622 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:38.798596 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" podUID="d3028f5f-7db5-49d8-a6ef-313f9402d2bd" containerName="istio-proxy" containerID="cri-o://338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a" gracePeriod=30 Jul 06 01:45:38.825392 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:38.825349 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:38.925178 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:38.925144 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:39.026385 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:39.026348 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:42.070259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:42.070222 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:44.473259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.473221 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:44.574343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.574307 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:44.650291 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.650255 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:44.652442 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.652034 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t"] Jul 06 01:45:44.652651 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.652523 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3028f5f-7db5-49d8-a6ef-313f9402d2bd" containerName="istio-proxy" Jul 06 01:45:44.652651 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.652541 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3028f5f-7db5-49d8-a6ef-313f9402d2bd" containerName="istio-proxy" Jul 06 01:45:44.652860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.652695 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3028f5f-7db5-49d8-a6ef-313f9402d2bd" containerName="istio-proxy" Jul 06 01:45:44.655569 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.655549 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.658130 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.658109 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-22d9eeec-openshift-default-dockercfg-d9stc\"" Jul 06 01:45:44.670257 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.670233 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t"] Jul 06 01:45:44.682183 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.682153 2571 generic.go:356] "Generic (PLEG): container finished" podID="d3028f5f-7db5-49d8-a6ef-313f9402d2bd" containerID="338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a" exitCode=0 Jul 06 01:45:44.682317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.682216 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" event={"ID":"d3028f5f-7db5-49d8-a6ef-313f9402d2bd","Type":"ContainerDied","Data":"338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a"} Jul 06 01:45:44.682317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.682265 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" Jul 06 01:45:44.682317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.682268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6" event={"ID":"d3028f5f-7db5-49d8-a6ef-313f9402d2bd","Type":"ContainerDied","Data":"9938d9efb09666c3fad56f1ef744b8d43cf46b2b0eadc1c39cd9d0c400aaddd2"} Jul 06 01:45:44.682317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.682299 2571 scope.go:117] "RemoveContainer" containerID="338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a" Jul 06 01:45:44.691095 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.691076 2571 scope.go:117] "RemoveContainer" containerID="338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a" Jul 06 01:45:44.691407 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:45:44.691382 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a\": container with ID starting with 338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a not found: ID does not exist" containerID="338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a" Jul 06 01:45:44.691466 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.691422 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a"} err="failed to get container status \"338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a\": rpc error: code = NotFound desc = could not find container \"338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a\": container with ID starting with 338805a938101f71fa19ff59d2a9d7ba148bf56b26a610affc80a21235b0853a not found: ID does not exist" Jul 06 01:45:44.693748 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.693727 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:44.742468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742374 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdz2r\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-kube-api-access-zdz2r\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742419 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istiod-ca-cert\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742446 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-credential-socket\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742509 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-socket\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742556 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-data\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742582 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-envoy\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742648 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-certs\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742706 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-token\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.742761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742736 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-podinfo\") pod \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\" (UID: \"d3028f5f-7db5-49d8-a6ef-313f9402d2bd\") " Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742760 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742849 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742868 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.742889 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-data\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743007 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c591331-1ff6-4902-be35-3ee7b105a11b-istiod-ca-cert\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743036 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-podinfo\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqfc\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-kube-api-access-kbqfc\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743143 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-socket\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743174 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-credential-socket\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743207 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-certs\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743266 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-envoy\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-token\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743337 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743359 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743389 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.743451 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.743404 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.744072 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.744050 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:45:44.745335 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.745299 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:45:44.745438 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.745393 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:45:44.745438 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.745414 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-kube-api-access-zdz2r" (OuterVolumeSpecName: "kube-api-access-zdz2r") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "kube-api-access-zdz2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:45:44.745512 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.745412 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3028f5f-7db5-49d8-a6ef-313f9402d2bd" (UID: "d3028f5f-7db5-49d8-a6ef-313f9402d2bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:45:44.794156 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.794103 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:44.844681 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844642 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-podinfo\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.844893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844699 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqfc\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-kube-api-access-kbqfc\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.844893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844729 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-socket\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.844893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844757 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-credential-socket\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.844893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844785 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-certs\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.844893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844816 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-envoy\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.844893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844847 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-token\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.844915 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-data\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845008 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c591331-1ff6-4902-be35-3ee7b105a11b-istiod-ca-cert\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845062 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845078 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845091 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845106 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdz2r\" (UniqueName: \"kubernetes.io/projected/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-kube-api-access-zdz2r\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845121 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.845263 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845136 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3028f5f-7db5-49d8-a6ef-313f9402d2bd-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:45:44.845670 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845285 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-certs\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845670 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-credential-socket\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845670 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845390 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-socket\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845670 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845590 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-data\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.845884 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.845824 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c591331-1ff6-4902-be35-3ee7b105a11b-istiod-ca-cert\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.847123 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.847103 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-envoy\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.847251 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.847236 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-podinfo\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.852674 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.852650 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqfc\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-kube-api-access-kbqfc\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.852787 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.852676 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-token\") pod \"e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:44.967206 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:44.967164 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:45.005550 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.005474 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6"] Jul 06 01:45:45.010614 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.010583 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-836a1b7b-openshift-default-5656d5c975-rp8g6"] Jul 06 01:45:45.101492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.101466 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t"] Jul 06 01:45:45.102923 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:45:45.102895 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c591331_1ff6_4902_be35_3ee7b105a11b.slice/crio-6a8d2c759a55bcffe3aaae85712b1e50ffbb757432cec98aa4fa63994615b8c4 WatchSource:0}: Error finding container 6a8d2c759a55bcffe3aaae85712b1e50ffbb757432cec98aa4fa63994615b8c4: Status 404 returned error can't find the container with id 6a8d2c759a55bcffe3aaae85712b1e50ffbb757432cec98aa4fa63994615b8c4 Jul 06 01:45:45.105361 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.105332 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:45.105458 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.105408 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:45.105521 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.105454 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:45.272350 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.272269 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3028f5f-7db5-49d8-a6ef-313f9402d2bd" path="/var/lib/kubelet/pods/d3028f5f-7db5-49d8-a6ef-313f9402d2bd/volumes" Jul 06 01:45:45.690778 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.690744 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" event={"ID":"6c591331-1ff6-4902-be35-3ee7b105a11b","Type":"ContainerStarted","Data":"90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21"} Jul 06 01:45:45.691213 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.690796 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" event={"ID":"6c591331-1ff6-4902-be35-3ee7b105a11b","Type":"ContainerStarted","Data":"6a8d2c759a55bcffe3aaae85712b1e50ffbb757432cec98aa4fa63994615b8c4"} Jul 06 01:45:45.711605 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.711554 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" podStartSLOduration=1.711538192 podStartE2EDuration="1.711538192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:45:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:45:45.709152154 +0000 UTC m=+1537.131955245" watchObservedRunningTime="2026-07-06 01:45:45.711538192 +0000 UTC m=+1537.134341246" Jul 06 01:45:45.786248 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.786214 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:45.872760 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.872721 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:45.941506 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.941419 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:45.970817 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:45.970773 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:46.041916 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:46.041873 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:46.325323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:46.325231 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:46.425872 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:46.425836 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:46.973427 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:46.973392 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:47.702229 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:47.702196 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:47.703069 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:47.703048 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:45:47.969086 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:47.969057 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:50.944715 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:50.944677 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:51.256494 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:51.256400 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:56.749866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:56.749833 2571 generic.go:356] "Generic (PLEG): container finished" podID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerID="90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21" exitCode=0 Jul 06 01:45:56.750323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:56.749895 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" event={"ID":"6c591331-1ff6-4902-be35-3ee7b105a11b","Type":"ContainerDied","Data":"90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21"} Jul 06 01:45:56.750323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:56.750313 2571 scope.go:117] "RemoveContainer" containerID="90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21" Jul 06 01:45:56.751377 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:56.751350 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:56.751495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:56.751436 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:56.751495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:56.751470 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:45:57.030216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:57.030124 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t"] Jul 06 01:45:57.053669 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:57.053629 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:57.162357 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:57.162322 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:45:57.758029 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:57.757992 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" event={"ID":"6c591331-1ff6-4902-be35-3ee7b105a11b","Type":"ContainerStarted","Data":"8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65"} Jul 06 01:45:57.758464 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:57.758092 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" containerID="cri-o://8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65" gracePeriod=30 Jul 06 01:45:59.452242 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:45:59.452195 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:02.702254 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:02.702220 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:46:02.965932 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:02.965846 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:03.006638 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.006616 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:46:03.068561 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.068528 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:03.104695 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104659 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-certs\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.104695 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104707 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-envoy\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.104977 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104738 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-credential-socket\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.104977 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104781 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbqfc\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-kube-api-access-kbqfc\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.104977 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104822 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-podinfo\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.104977 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104912 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c591331-1ff6-4902-be35-3ee7b105a11b-istiod-ca-cert\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.104977 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104940 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-socket\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.105257 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.104979 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-token\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.105257 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105042 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-data\") pod \"6c591331-1ff6-4902-be35-3ee7b105a11b\" (UID: \"6c591331-1ff6-4902-be35-3ee7b105a11b\") " Jul 06 01:46:03.105257 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105064 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:03.105257 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105193 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:03.105457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105323 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.105457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105342 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.105457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105393 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c591331-1ff6-4902-be35-3ee7b105a11b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:46:03.105616 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105591 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:03.105939 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.105917 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:03.107465 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.107355 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-kube-api-access-kbqfc" (OuterVolumeSpecName: "kube-api-access-kbqfc") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "kube-api-access-kbqfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:46:03.107661 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.107558 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:46:03.107661 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.107562 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:03.107661 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.107578 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c591331-1ff6-4902-be35-3ee7b105a11b" (UID: "6c591331-1ff6-4902-be35-3ee7b105a11b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:46:03.149161 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149127 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc"] Jul 06 01:46:03.149478 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149466 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" Jul 06 01:46:03.149516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149480 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" Jul 06 01:46:03.149516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149489 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" Jul 06 01:46:03.149516 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149495 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" Jul 06 01:46:03.149625 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149549 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" Jul 06 01:46:03.149625 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.149558 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerName="istio-proxy" Jul 06 01:46:03.152802 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.152782 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.155081 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.155059 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f42a3931-openshift-default-dockercfg-9pmf4\"" Jul 06 01:46:03.164830 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.164806 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc"] Jul 06 01:46:03.177502 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.177471 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:03.205968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.205911 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-socket\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.205968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.205969 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-podinfo\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206003 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-certs\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206024 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istiod-ca-cert\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-data\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206140 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-token\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206183 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-envoy\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206232 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jn9\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-kube-api-access-98jn9\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206280 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-credential-socket\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206354 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c591331-1ff6-4902-be35-3ee7b105a11b-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206365 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206373 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206381 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206389 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c591331-1ff6-4902-be35-3ee7b105a11b-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206397 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbqfc\" (UniqueName: \"kubernetes.io/projected/6c591331-1ff6-4902-be35-3ee7b105a11b-kube-api-access-kbqfc\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.206447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.206405 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c591331-1ff6-4902-be35-3ee7b105a11b-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:03.278008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.277910 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:03.307412 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-credential-socket\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307431 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-socket\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307450 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-podinfo\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307471 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-certs\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istiod-ca-cert\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-data\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307602 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-token\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307931 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307693 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-envoy\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307931 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307763 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jn9\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-kube-api-access-98jn9\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307931 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307822 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-credential-socket\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.307931 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307872 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-socket\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.308155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.307986 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-data\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.308155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.308115 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-certs\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.308283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.308264 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istiod-ca-cert\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.309985 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.309967 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-envoy\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.310146 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.310131 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-podinfo\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.315407 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.315383 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jn9\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-kube-api-access-98jn9\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.315878 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.315861 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-token\") pod \"e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.466105 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.466062 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:03.603142 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.603118 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc"] Jul 06 01:46:03.604055 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:46:03.604032 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf289c17_7ef4_42a6_a35a_42c5aa61d2cc.slice/crio-d5a4a39d0849655d70ddfd7e98e71ea2dfa7cddc14304a4b3e6dd3b4fb4bbff7 WatchSource:0}: Error finding container d5a4a39d0849655d70ddfd7e98e71ea2dfa7cddc14304a4b3e6dd3b4fb4bbff7: Status 404 returned error can't find the container with id d5a4a39d0849655d70ddfd7e98e71ea2dfa7cddc14304a4b3e6dd3b4fb4bbff7 Jul 06 01:46:03.612070 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.607199 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:46:03.612070 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.607337 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:46:03.612070 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.607415 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:46:03.798969 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.798918 2571 generic.go:356] "Generic (PLEG): container finished" podID="6c591331-1ff6-4902-be35-3ee7b105a11b" containerID="8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65" exitCode=0 Jul 06 01:46:03.799457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.799011 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" Jul 06 01:46:03.799457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.799013 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" event={"ID":"6c591331-1ff6-4902-be35-3ee7b105a11b","Type":"ContainerDied","Data":"8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65"} Jul 06 01:46:03.799457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.799120 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t" event={"ID":"6c591331-1ff6-4902-be35-3ee7b105a11b","Type":"ContainerDied","Data":"6a8d2c759a55bcffe3aaae85712b1e50ffbb757432cec98aa4fa63994615b8c4"} Jul 06 01:46:03.799457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.799153 2571 scope.go:117] "RemoveContainer" containerID="8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65" Jul 06 01:46:03.802293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.801458 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" event={"ID":"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc","Type":"ContainerStarted","Data":"76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513"} Jul 06 01:46:03.802293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.801512 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" event={"ID":"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc","Type":"ContainerStarted","Data":"d5a4a39d0849655d70ddfd7e98e71ea2dfa7cddc14304a4b3e6dd3b4fb4bbff7"} Jul 06 01:46:03.809521 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.809498 2571 scope.go:117] "RemoveContainer" containerID="90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21" Jul 06 01:46:03.819546 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.819518 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t"] Jul 06 01:46:03.820788 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.820767 2571 scope.go:117] "RemoveContainer" containerID="8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65" Jul 06 01:46:03.821125 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:46:03.821104 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65\": container with ID starting with 8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65 not found: ID does not exist" containerID="8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65" Jul 06 01:46:03.821210 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.821138 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65"} err="failed to get container status \"8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65\": rpc error: code = NotFound desc = could not find container \"8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65\": container with ID starting with 8ce10efe91bb15d00499fe80979c70d69d756c83d2382e7cf5faeab6ba10ee65 not found: ID does not exist" Jul 06 01:46:03.821210 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.821164 2571 scope.go:117] "RemoveContainer" containerID="90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21" Jul 06 01:46:03.821443 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:46:03.821419 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21\": container with ID starting with 90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21 not found: ID does not exist" containerID="90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21" Jul 06 01:46:03.821509 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.821452 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21"} err="failed to get container status \"90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21\": rpc error: code = NotFound desc = could not find container \"90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21\": container with ID starting with 90bfe0bc7b4b07a65f0b85bf4d8410fe15c7e9b602f254e30fc4a6cc502adc21 not found: ID does not exist" Jul 06 01:46:03.823110 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.823083 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-22d9eeec-openshift-default-67cbf4769c-9kx7t"] Jul 06 01:46:03.841265 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:03.841199 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" podStartSLOduration=0.841176886 podStartE2EDuration="841.176886ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:46:03.837643736 +0000 UTC m=+1555.260446792" watchObservedRunningTime="2026-07-06 01:46:03.841176886 +0000 UTC m=+1555.263979944" Jul 06 01:46:04.270575 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.270540 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:04.371253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.371219 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:04.466356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.466325 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:04.471578 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.471551 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:04.491331 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.491297 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:04.622479 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.622389 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:04.808345 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.808314 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:04.809302 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.809279 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:04.946165 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:04.946129 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:05.054432 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:05.054399 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:05.272012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:05.271964 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c591331-1ff6-4902-be35-3ee7b105a11b" path="/var/lib/kubelet/pods/6c591331-1ff6-4902-be35-3ee7b105a11b/volumes" Jul 06 01:46:06.440324 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:06.440296 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:08.745284 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:08.745242 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:08.911738 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:08.911696 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc"] Jul 06 01:46:08.911928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:08.911902 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" podUID="cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" containerName="istio-proxy" containerID="cri-o://76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513" gracePeriod=30 Jul 06 01:46:10.064530 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:10.064495 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:10.740109 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:10.740076 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:14.173344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.173277 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:14.315613 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315577 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-podinfo\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315613 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315622 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-data\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315638 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-envoy\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315662 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-socket\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315700 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-credential-socket\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315751 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istiod-ca-cert\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315770 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98jn9\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-kube-api-access-98jn9\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315789 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-token\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.315859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.315826 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-certs\") pod \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\" (UID: \"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc\") " Jul 06 01:46:14.316267 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.316043 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:14.316267 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.316111 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:14.316267 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.316139 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:14.316434 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.316286 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:14.316521 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.316493 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:46:14.317911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.317886 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:46:14.318063 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.317992 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:46:14.318121 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.318067 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:46:14.318121 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.318089 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-kube-api-access-98jn9" (OuterVolumeSpecName: "kube-api-access-98jn9") pod "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" (UID: "cf289c17-7ef4-42a6-a35a-42c5aa61d2cc"). InnerVolumeSpecName "kube-api-access-98jn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:46:14.416910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416868 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.416910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416901 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.416910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416911 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.416910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416919 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.417216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416929 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.417216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416939 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.417216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416975 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98jn9\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-kube-api-access-98jn9\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.417216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416984 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.417216 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.416992 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:46:14.699299 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.699257 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:14.799672 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.799640 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:14.861066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.861033 2571 generic.go:356] "Generic (PLEG): container finished" podID="cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" containerID="76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513" exitCode=0 Jul 06 01:46:14.861253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.861085 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" Jul 06 01:46:14.861253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.861124 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" event={"ID":"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc","Type":"ContainerDied","Data":"76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513"} Jul 06 01:46:14.861253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.861190 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc" event={"ID":"cf289c17-7ef4-42a6-a35a-42c5aa61d2cc","Type":"ContainerDied","Data":"d5a4a39d0849655d70ddfd7e98e71ea2dfa7cddc14304a4b3e6dd3b4fb4bbff7"} Jul 06 01:46:14.861253 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.861220 2571 scope.go:117] "RemoveContainer" containerID="76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513" Jul 06 01:46:14.870551 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.870534 2571 scope.go:117] "RemoveContainer" containerID="76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513" Jul 06 01:46:14.870841 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:46:14.870823 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513\": container with ID starting with 76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513 not found: ID does not exist" containerID="76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513" Jul 06 01:46:14.870884 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.870851 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513"} err="failed to get container status \"76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513\": rpc error: code = NotFound desc = could not find container \"76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513\": container with ID starting with 76fd22aeae9d50b2acf22a8eb88436aec6c47c1b4b0d4cb65691db19d2696513 not found: ID does not exist" Jul 06 01:46:14.882909 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.882881 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc"] Jul 06 01:46:14.888921 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:14.888897 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f42a3931-openshift-default-77b9fd8f79-5h7hc"] Jul 06 01:46:15.189671 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:15.189636 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:15.271230 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:15.271195 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" path="/var/lib/kubelet/pods/cf289c17-7ef4-42a6-a35a-42c5aa61d2cc/volumes" Jul 06 01:46:15.296551 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:15.296523 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:15.413834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:15.413797 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:16.806771 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:16.806733 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:22.651710 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:22.651671 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:22.754167 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:22.754130 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:22.849912 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:22.849881 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:22.950148 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:22.950118 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:23.376338 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:23.376220 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:49.338966 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:49.338911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:55.087747 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:55.087708 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:55.148635 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:55.148605 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:55.219574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:55.219541 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:46:55.319486 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:46:55.319443 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:11.196179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:11.196138 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:16.836709 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:16.836667 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:16.941034 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:16.940997 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:17.034976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:17.034911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:27.577690 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:27.577654 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:28.393632 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:28.393597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:34.220041 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:34.219975 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:34.325557 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:34.325517 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:34.423380 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:34.423348 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:34.525448 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:34.525362 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:35.301178 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:35.301137 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:35.399414 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:35.399377 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:35.498828 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:35.498796 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:37.181273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:37.181232 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:43.160812 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:43.160772 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:43.232490 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:43.232459 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:43.839928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:43.839890 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:49.458710 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.458675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:49.520610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.520575 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:49.719460 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.719375 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:49.997510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.997431 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw"] Jul 06 01:47:49.997776 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.997764 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" containerName="istio-proxy" Jul 06 01:47:49.997821 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.997778 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" containerName="istio-proxy" Jul 06 01:47:49.997860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:49.997843 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf289c17-7ef4-42a6-a35a-42c5aa61d2cc" containerName="istio-proxy" Jul 06 01:47:50.000848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.000829 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.003166 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.003141 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-17e353c4-openshift-default-dockercfg-99pp5\"" Jul 06 01:47:50.017280 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.017254 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw"] Jul 06 01:47:50.023789 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.023763 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:50.034994 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.034956 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96f7p\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-kube-api-access-96f7p\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035141 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035011 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-credential-socket\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035141 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035054 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-socket\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035141 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035073 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-envoy\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035164 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-certs\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d8d7601-7696-40fb-b5fb-ccc478194c41-istiod-ca-cert\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035235 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-data\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035317 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-podinfo\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.035464 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.035344 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-token\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136081 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136037 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-socket\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136081 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136079 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-envoy\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136305 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136113 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-certs\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136305 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136136 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d8d7601-7696-40fb-b5fb-ccc478194c41-istiod-ca-cert\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136305 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136258 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-data\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136471 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136354 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-podinfo\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136471 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136393 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-token\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136471 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136435 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96f7p\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-kube-api-access-96f7p\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136471 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136462 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-credential-socket\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136685 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136493 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-socket\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136845 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136824 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-data\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.136931 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.136914 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-credential-socket\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.137037 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.137016 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d8d7601-7696-40fb-b5fb-ccc478194c41-istiod-ca-cert\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.137100 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.137044 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-certs\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.138508 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.138484 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-envoy\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.139155 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.139133 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-podinfo\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.144435 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.144407 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96f7p\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-kube-api-access-96f7p\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.144546 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.144421 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-token\") pod \"e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.312165 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.312068 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:50.459019 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.458993 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw"] Jul 06 01:47:50.461128 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:47:50.461103 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8d7601_7696_40fb_b5fb_ccc478194c41.slice/crio-820dc815abf45f406c9baf6d7fd552a05fc64fa9f54a9e1ca4db9191e854a7d0 WatchSource:0}: Error finding container 820dc815abf45f406c9baf6d7fd552a05fc64fa9f54a9e1ca4db9191e854a7d0: Status 404 returned error can't find the container with id 820dc815abf45f406c9baf6d7fd552a05fc64fa9f54a9e1ca4db9191e854a7d0 Jul 06 01:47:50.463709 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.463682 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:47:50.463767 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.463742 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:47:50.463816 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.463772 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:47:50.476383 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:50.476351 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:51.362565 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:51.362523 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" event={"ID":"7d8d7601-7696-40fb-b5fb-ccc478194c41","Type":"ContainerStarted","Data":"bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f"} Jul 06 01:47:51.362758 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:51.362588 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" event={"ID":"7d8d7601-7696-40fb-b5fb-ccc478194c41","Type":"ContainerStarted","Data":"820dc815abf45f406c9baf6d7fd552a05fc64fa9f54a9e1ca4db9191e854a7d0"} Jul 06 01:47:51.386311 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:51.386261 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" podStartSLOduration=2.386246104 podStartE2EDuration="2.386246104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:47:51.384176152 +0000 UTC m=+1662.806979237" watchObservedRunningTime="2026-07-06 01:47:51.386246104 +0000 UTC m=+1662.809049159" Jul 06 01:47:52.313129 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:52.313088 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:52.317992 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:52.317969 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:52.367411 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:52.367376 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:52.368406 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:52.368383 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:47:53.304781 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:53.304729 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:53.378208 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:53.378160 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:53.446990 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:53.446962 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:53.854706 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:53.854675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:53.954681 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:53.954643 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:57.833031 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:57.833001 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:58.522581 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:58.522546 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:58.624267 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:58.624233 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:47:58.998735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:47:58.998694 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:04.875169 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:04.875134 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:04.978617 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:04.978570 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:05.293067 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:05.293033 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:05.581517 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:05.581419 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:05.708728 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:05.708689 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:07.610488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:07.609290 2571 patch_prober.go:28] interesting pod/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:48050->10.133.0.45:15021: read: connection reset by peer" start-of-body= Jul 06 01:48:07.610488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:07.609358 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:48050->10.133.0.45:15021: read: connection reset by peer" Jul 06 01:48:08.450158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:08.450127 2571 generic.go:356] "Generic (PLEG): container finished" podID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerID="bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f" exitCode=0 Jul 06 01:48:08.450345 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:08.450201 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" event={"ID":"7d8d7601-7696-40fb-b5fb-ccc478194c41","Type":"ContainerDied","Data":"bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f"} Jul 06 01:48:08.450638 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:08.450617 2571 scope.go:117] "RemoveContainer" containerID="bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f" Jul 06 01:48:08.451638 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:08.451614 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:08.451694 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:08.451681 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:08.451730 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:08.451712 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:09.465400 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:09.465355 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" event={"ID":"7d8d7601-7696-40fb-b5fb-ccc478194c41","Type":"ContainerStarted","Data":"6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42"} Jul 06 01:48:10.312757 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:10.312722 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:48:10.316225 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:10.316197 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:48:10.470987 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:10.470884 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:48:10.471865 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:10.471849 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:48:11.328269 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:11.328222 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:11.390127 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:11.390090 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:11.576359 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:11.576325 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw"] Jul 06 01:48:11.592990 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:11.592891 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:11.840775 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:11.840739 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:11.998540 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:11.998507 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:12.094493 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:12.094454 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:12.215855 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:12.215815 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:12.481383 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:12.481349 2571 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" secret="" err="secret \"e2e-mt-17e353c4-openshift-default-dockercfg-99pp5\" not found" Jul 06 01:48:13.485936 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:13.485895 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" containerID="cri-o://6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42" gracePeriod=30 Jul 06 01:48:17.875033 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:17.874992 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:17.936769 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:17.936732 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:18.013998 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.013969 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:18.111976 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.111918 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:18.237197 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.237163 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:18.744120 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.744090 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:48:18.911443 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911416 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-podinfo\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911465 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-socket\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911487 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-credential-socket\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911681 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-certs\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911735 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96f7p\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-kube-api-access-96f7p\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911733 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911748 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911762 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d8d7601-7696-40fb-b5fb-ccc478194c41-istiod-ca-cert\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.911888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911812 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-data\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.912356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911914 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:48:18.912356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.911931 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-token\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.912356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912034 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-envoy\") pod \"7d8d7601-7696-40fb-b5fb-ccc478194c41\" (UID: \"7d8d7601-7696-40fb-b5fb-ccc478194c41\") " Jul 06 01:48:18.912356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912133 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d8d7601-7696-40fb-b5fb-ccc478194c41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:48:18.912356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912341 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:18.912601 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912362 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:18.912601 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912373 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:18.912601 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912383 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d8d7601-7696-40fb-b5fb-ccc478194c41-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:18.912831 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.912806 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:48:18.914198 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.914176 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:48:18.914293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.914178 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:48:18.914338 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.914291 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-kube-api-access-96f7p" (OuterVolumeSpecName: "kube-api-access-96f7p") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "kube-api-access-96f7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:48:18.914338 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:18.914308 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d8d7601-7696-40fb-b5fb-ccc478194c41" (UID: "7d8d7601-7696-40fb-b5fb-ccc478194c41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:48:19.013108 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.013077 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:19.013108 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.013103 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:19.013108 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.013111 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:19.013326 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.013119 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d8d7601-7696-40fb-b5fb-ccc478194c41-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:19.013326 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.013128 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96f7p\" (UniqueName: \"kubernetes.io/projected/7d8d7601-7696-40fb-b5fb-ccc478194c41-kube-api-access-96f7p\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:48:19.525687 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.525654 2571 generic.go:356] "Generic (PLEG): container finished" podID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerID="6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42" exitCode=0 Jul 06 01:48:19.525873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.525706 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" Jul 06 01:48:19.525873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.525742 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" event={"ID":"7d8d7601-7696-40fb-b5fb-ccc478194c41","Type":"ContainerDied","Data":"6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42"} Jul 06 01:48:19.525873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.525798 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw" event={"ID":"7d8d7601-7696-40fb-b5fb-ccc478194c41","Type":"ContainerDied","Data":"820dc815abf45f406c9baf6d7fd552a05fc64fa9f54a9e1ca4db9191e854a7d0"} Jul 06 01:48:19.525873 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.525824 2571 scope.go:117] "RemoveContainer" containerID="6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42" Jul 06 01:48:19.534554 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.534541 2571 scope.go:117] "RemoveContainer" containerID="bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f" Jul 06 01:48:19.542343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.542325 2571 scope.go:117] "RemoveContainer" containerID="6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42" Jul 06 01:48:19.542586 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:48:19.542564 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42\": container with ID starting with 6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42 not found: ID does not exist" containerID="6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42" Jul 06 01:48:19.542658 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.542593 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42"} err="failed to get container status \"6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42\": rpc error: code = NotFound desc = could not find container \"6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42\": container with ID starting with 6d42d83be75456b90fe68dc92b4cf87dc0c14736d1bf3631517bf1fe19b36c42 not found: ID does not exist" Jul 06 01:48:19.542658 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.542608 2571 scope.go:117] "RemoveContainer" containerID="bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f" Jul 06 01:48:19.542829 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:48:19.542812 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f\": container with ID starting with bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f not found: ID does not exist" containerID="bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f" Jul 06 01:48:19.542888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.542830 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f"} err="failed to get container status \"bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f\": rpc error: code = NotFound desc = could not find container \"bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f\": container with ID starting with bbf5fb0d16eabb62618148434182769bbd267ac05bc5c79d90d765461b24ef6f not found: ID does not exist" Jul 06 01:48:19.545788 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.545766 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw"] Jul 06 01:48:19.551831 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:19.551806 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-17e353c4-openshift-default-657f458fbc-tl2tw"] Jul 06 01:48:21.271047 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:21.271010 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" path="/var/lib/kubelet/pods/7d8d7601-7696-40fb-b5fb-ccc478194c41/volumes" Jul 06 01:48:23.838708 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:23.838678 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:23.942107 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:23.942070 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:30.695561 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.695525 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:30.997657 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.997567 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d"] Jul 06 01:48:30.998060 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.998046 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" Jul 06 01:48:30.998114 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.998064 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" Jul 06 01:48:30.998114 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.998081 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" Jul 06 01:48:30.998114 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.998091 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" Jul 06 01:48:30.998212 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:30.998183 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" Jul 06 01:48:31.003022 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.002996 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.005488 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.005461 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3c8390c1-openshift-default-dockercfg-m7wsz\"" Jul 06 01:48:31.013245 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.013220 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d"] Jul 06 01:48:31.031005 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.030970 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:31.120750 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.120714 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-envoy\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.120922 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.120755 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-socket\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.120922 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.120776 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-podinfo\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.120922 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.120828 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-token\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.121145 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.121010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-credential-socket\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.121145 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.121056 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-certs\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.121145 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.121115 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b2fdf51-0856-483f-8400-ba2599a13b3a-istiod-ca-cert\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.121298 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.121146 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7wq\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-kube-api-access-5t7wq\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.121298 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.121179 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-data\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222252 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222163 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-credential-socket\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222252 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222216 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-certs\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222256 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b2fdf51-0856-483f-8400-ba2599a13b3a-istiod-ca-cert\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7wq\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-kube-api-access-5t7wq\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222320 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-data\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222424 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-envoy\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222458 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-socket\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222482 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-podinfo\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222504 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-token\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222633 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-credential-socket\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222684 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-certs\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.222809 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222727 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-data\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.223024 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.222878 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-socket\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.223115 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.223094 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b2fdf51-0856-483f-8400-ba2599a13b3a-istiod-ca-cert\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.224800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.224773 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-envoy\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.225089 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.225071 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-podinfo\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.233751 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.233725 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-token\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.234643 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.234621 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7wq\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-kube-api-access-5t7wq\") pod \"e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.314661 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.314569 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:31.452433 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.452391 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d"] Jul 06 01:48:31.454182 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:48:31.454157 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2fdf51_0856_483f_8400_ba2599a13b3a.slice/crio-bc70bd8e440ab1b4e14bb095af835f36c2f328e889d1b76dc0769e475ef8789f WatchSource:0}: Error finding container bc70bd8e440ab1b4e14bb095af835f36c2f328e889d1b76dc0769e475ef8789f: Status 404 returned error can't find the container with id bc70bd8e440ab1b4e14bb095af835f36c2f328e889d1b76dc0769e475ef8789f Jul 06 01:48:31.456447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.456420 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:31.456518 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.456481 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:31.456518 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.456510 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:31.589606 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.589515 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:31.591702 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.591677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" event={"ID":"3b2fdf51-0856-483f-8400-ba2599a13b3a","Type":"ContainerStarted","Data":"e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f"} Jul 06 01:48:31.591835 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.591724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" event={"ID":"3b2fdf51-0856-483f-8400-ba2599a13b3a","Type":"ContainerStarted","Data":"bc70bd8e440ab1b4e14bb095af835f36c2f328e889d1b76dc0769e475ef8789f"} Jul 06 01:48:31.612720 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:31.612671 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" podStartSLOduration=1.612655845 podStartE2EDuration="1.612655845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:48:31.610275399 +0000 UTC m=+1703.033078455" watchObservedRunningTime="2026-07-06 01:48:31.612655845 +0000 UTC m=+1703.035458977" Jul 06 01:48:32.315364 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:32.315329 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:32.320078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:32.320053 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:32.596644 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:32.596563 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:32.597559 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:32.597540 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:33.508264 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:33.508223 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:33.585657 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:33.585606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:33.653008 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:33.652976 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:33.778571 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:33.778486 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:34.276847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:34.276816 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:34.391165 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:34.391133 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:38.064323 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:38.064290 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:46.680719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:46.680684 2571 generic.go:356] "Generic (PLEG): container finished" podID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerID="e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f" exitCode=0 Jul 06 01:48:46.681158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:46.680760 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" event={"ID":"3b2fdf51-0856-483f-8400-ba2599a13b3a","Type":"ContainerDied","Data":"e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f"} Jul 06 01:48:46.681211 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:46.681199 2571 scope.go:117] "RemoveContainer" containerID="e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f" Jul 06 01:48:46.682180 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:46.682156 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:46.682255 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:46.682242 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:46.682293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:46.682277 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:48:47.596680 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:47.596645 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:47.687863 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:47.687829 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" event={"ID":"3b2fdf51-0856-483f-8400-ba2599a13b3a","Type":"ContainerStarted","Data":"673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0"} Jul 06 01:48:48.315766 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:48.315724 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:48.317011 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:48.316986 2571 patch_prober.go:28] interesting pod/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 06 01:48:48.317120 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:48.317050 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 06 01:48:49.315705 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:49.315665 2571 patch_prober.go:28] interesting pod/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 06 01:48:49.316146 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:49.315728 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 06 01:48:50.171355 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:50.171317 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:50.274840 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:50.274808 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:50.315893 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:50.315852 2571 patch_prober.go:28] interesting pod/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 06 01:48:50.316377 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:50.315937 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 06 01:48:51.314998 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:51.314964 2571 patch_prober.go:28] interesting pod/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 06 01:48:51.315208 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:51.315025 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 06 01:48:51.795663 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:51.795630 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:52.318982 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:52.318937 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:52.319249 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:52.319228 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:52.319959 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:52.319930 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:48:55.059988 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:55.059927 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:55.157082 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:55.157048 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:48:55.719075 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:48:55.719044 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:49:15.770707 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:49:15.770667 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:49:16.164417 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:49:16.164381 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:49:21.908622 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:49:21.908586 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:49:26.940215 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:49:26.940179 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:49:32.232448 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:49:32.232408 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:49:32.332233 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:49:32.332200 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:03.085315 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:03.085243 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:04.006706 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:04.006656 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:09.159848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.159819 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:50:09.162570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.162551 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:50:09.480179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.480096 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:09.579709 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.579675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:09.738614 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.738521 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d"] Jul 06 01:50:09.738783 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.738740 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" containerID="cri-o://673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0" gracePeriod=30 Jul 06 01:50:09.758265 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:09.758226 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:10.004013 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:10.003915 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:11.081478 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:11.081430 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:11.183658 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:11.183621 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:11.279222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:11.279191 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:12.042522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:12.042489 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:12.140151 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:12.140115 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:12.203842 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:12.203812 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:13.647918 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:13.647887 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:14.987338 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:14.987316 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:50:15.041911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.041817 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t7wq\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-kube-api-access-5t7wq\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.041911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.041864 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-token\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.041911 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.041887 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-data\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.041934 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b2fdf51-0856-483f-8400-ba2599a13b3a-istiod-ca-cert\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.041993 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-socket\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042022 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-credential-socket\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042047 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-envoy\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042071 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-certs\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042160 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-podinfo\") pod \"3b2fdf51-0856-483f-8400-ba2599a13b3a\" (UID: \"3b2fdf51-0856-483f-8400-ba2599a13b3a\") " Jul 06 01:50:15.042527 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042282 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:50:15.042527 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042302 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:50:15.042527 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042369 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2fdf51-0856-483f-8400-ba2599a13b3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:50:15.042527 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042490 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b2fdf51-0856-483f-8400-ba2599a13b3a-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.042724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042582 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:50:15.042724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042614 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.042724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042633 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.042889 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.042855 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:50:15.044300 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.044268 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:50:15.044300 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.044264 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:50:15.044556 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.044541 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:50:15.044617 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.044559 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-kube-api-access-5t7wq" (OuterVolumeSpecName: "kube-api-access-5t7wq") pod "3b2fdf51-0856-483f-8400-ba2599a13b3a" (UID: "3b2fdf51-0856-483f-8400-ba2599a13b3a"). InnerVolumeSpecName "kube-api-access-5t7wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:50:15.143231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.143202 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.143231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.143225 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.143231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.143234 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.143537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.143242 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t7wq\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-kube-api-access-5t7wq\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.143537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.143251 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.143537 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.143258 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b2fdf51-0856-483f-8400-ba2599a13b3a-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:50:15.144774 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.144745 2571 generic.go:356] "Generic (PLEG): container finished" podID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerID="673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0" exitCode=0 Jul 06 01:50:15.144868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.144800 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" Jul 06 01:50:15.144868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.144822 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" event={"ID":"3b2fdf51-0856-483f-8400-ba2599a13b3a","Type":"ContainerDied","Data":"673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0"} Jul 06 01:50:15.145018 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.144873 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d" event={"ID":"3b2fdf51-0856-483f-8400-ba2599a13b3a","Type":"ContainerDied","Data":"bc70bd8e440ab1b4e14bb095af835f36c2f328e889d1b76dc0769e475ef8789f"} Jul 06 01:50:15.145018 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.144895 2571 scope.go:117] "RemoveContainer" containerID="673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0" Jul 06 01:50:15.154653 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.154631 2571 scope.go:117] "RemoveContainer" containerID="e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f" Jul 06 01:50:15.163214 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.163192 2571 scope.go:117] "RemoveContainer" containerID="673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0" Jul 06 01:50:15.163551 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:50:15.163525 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0\": container with ID starting with 673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0 not found: ID does not exist" containerID="673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0" Jul 06 01:50:15.163641 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.163557 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0"} err="failed to get container status \"673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0\": rpc error: code = NotFound desc = could not find container \"673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0\": container with ID starting with 673c2c8eeb01628ce4b955b301f1de723895561f207b1d7c543bf546eaecd2d0 not found: ID does not exist" Jul 06 01:50:15.163641 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.163574 2571 scope.go:117] "RemoveContainer" containerID="e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f" Jul 06 01:50:15.163838 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:50:15.163821 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f\": container with ID starting with e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f not found: ID does not exist" containerID="e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f" Jul 06 01:50:15.163875 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.163844 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f"} err="failed to get container status \"e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f\": rpc error: code = NotFound desc = could not find container \"e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f\": container with ID starting with e345c986a9f2ea604db4c57d34d3e8a1d1d24fab526c98501d21c60cbd27c68f not found: ID does not exist" Jul 06 01:50:15.165668 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.165649 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d"] Jul 06 01:50:15.169559 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.169538 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3c8390c1-openshift-default-bd68cf5f5-hqf7d"] Jul 06 01:50:15.270799 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:15.270760 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" path="/var/lib/kubelet/pods/3b2fdf51-0856-483f-8400-ba2599a13b3a/volumes" Jul 06 01:50:19.544307 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:19.544270 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:19.672260 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:19.672227 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:20.205092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:20.205044 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:25.824884 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:25.824849 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:25.930881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:25.930848 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:26.025515 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:26.025484 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:36.544177 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:36.544139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:36.900912 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:36.900828 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:50:57.897917 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:50:57.897876 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:03.672940 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:03.672903 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:03.732315 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:03.732283 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:04.036640 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.036555 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:04.404069 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.403977 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc"] Jul 06 01:51:04.404322 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.404310 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" Jul 06 01:51:04.404368 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.404324 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" Jul 06 01:51:04.404420 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.404411 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8d7601-7696-40fb-b5fb-ccc478194c41" containerName="istio-proxy" Jul 06 01:51:04.404459 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.404423 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" Jul 06 01:51:04.404459 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.404431 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" Jul 06 01:51:04.407460 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.407441 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.410293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.410278 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-03c9df-openshift-default-dockercfg-jrg2s\"" Jul 06 01:51:04.420566 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.420516 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:04.433742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.433708 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc"] Jul 06 01:51:04.485541 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485495 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-certs\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.485541 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485542 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2604b110-98f3-4ab3-b1ae-c766099e7379-istiod-ca-cert\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.485797 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485570 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzx4\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-kube-api-access-qmzx4\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.485797 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485636 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-envoy\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.485797 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485672 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-data\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.485797 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485694 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-podinfo\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.485797 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485737 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-credential-socket\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.486095 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485825 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-token\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.486095 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.485866 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-socket\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587002 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.586935 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-data\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587002 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587009 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-podinfo\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587053 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-credential-socket\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587093 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-token\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587118 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-socket\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-certs\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587228 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2604b110-98f3-4ab3-b1ae-c766099e7379-istiod-ca-cert\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587257 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzx4\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-kube-api-access-qmzx4\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587394 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-data\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587414 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-envoy\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587655 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-certs\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587716 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587682 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-credential-socket\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.587796 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.587753 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-socket\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.588148 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.588118 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2604b110-98f3-4ab3-b1ae-c766099e7379-istiod-ca-cert\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.589692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.589670 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-envoy\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.590044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.590023 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-podinfo\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.595152 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.595126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-token\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.595343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.595328 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzx4\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-kube-api-access-qmzx4\") pod \"e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.631288 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.631220 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:04.717582 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.717548 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:04.854145 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.854116 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc"] Jul 06 01:51:04.855928 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:51:04.855903 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2604b110_98f3_4ab3_b1ae_c766099e7379.slice/crio-0dbbce9a0ef88cbd5d15e16bbb67a8edd3602af09cedbb8da72d7afae549c779 WatchSource:0}: Error finding container 0dbbce9a0ef88cbd5d15e16bbb67a8edd3602af09cedbb8da72d7afae549c779: Status 404 returned error can't find the container with id 0dbbce9a0ef88cbd5d15e16bbb67a8edd3602af09cedbb8da72d7afae549c779 Jul 06 01:51:04.858138 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.858098 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:04.858219 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.858183 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:04.858262 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:04.858225 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:05.407280 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:05.407231 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" event={"ID":"2604b110-98f3-4ab3-b1ae-c766099e7379","Type":"ContainerStarted","Data":"03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5"} Jul 06 01:51:05.407491 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:05.407328 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" event={"ID":"2604b110-98f3-4ab3-b1ae-c766099e7379","Type":"ContainerStarted","Data":"0dbbce9a0ef88cbd5d15e16bbb67a8edd3602af09cedbb8da72d7afae549c779"} Jul 06 01:51:05.429375 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:05.429323 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podStartSLOduration=1.429307292 podStartE2EDuration="1.429307292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:51:05.426088066 +0000 UTC m=+1856.848891115" watchObservedRunningTime="2026-07-06 01:51:05.429307292 +0000 UTC m=+1856.852110347" Jul 06 01:51:05.718154 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:05.718114 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:05.723143 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:05.723117 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:06.412785 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:06.412748 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:06.413858 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:06.413836 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:07.365321 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:07.365280 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:07.443025 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:07.442966 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:07.515097 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:07.515059 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:07.852249 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:07.852211 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:07.950433 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:07.950403 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:08.051046 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:08.051009 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:11.883750 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:11.883713 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:12.526360 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.526324 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb"] Jul 06 01:51:12.526738 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.526721 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" Jul 06 01:51:12.526821 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.526741 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2fdf51-0856-483f-8400-ba2599a13b3a" containerName="istio-proxy" Jul 06 01:51:12.529853 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.529831 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.533591 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.533568 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7c01b8-openshift-default-dockercfg-cs925\"" Jul 06 01:51:12.562800 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.562769 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb"] Jul 06 01:51:12.565230 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565203 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-socket\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565273 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-credential-socket\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565412 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565363 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-certs\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565422 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-envoy\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565448 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-podinfo\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565540 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565472 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f456a6e-4d4f-4287-871f-0db77fc03072-istiod-ca-cert\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565575 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565563 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4flsp\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-kube-api-access-4flsp\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565626 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565609 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-data\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.565698 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.565673 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-token\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667015 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.666982 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-data\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667023 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-token\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667051 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-socket\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667099 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-credential-socket\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667119 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-certs\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667159 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-envoy\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667182 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-podinfo\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667227 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667209 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f456a6e-4d4f-4287-871f-0db77fc03072-istiod-ca-cert\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667604 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4flsp\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-kube-api-access-4flsp\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667604 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667484 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-data\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667604 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667544 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-credential-socket\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667762 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667611 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-certs\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.667843 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.667803 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-socket\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.668105 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.668085 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f456a6e-4d4f-4287-871f-0db77fc03072-istiod-ca-cert\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.669549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.669528 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-envoy\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.670016 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.669999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-podinfo\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.684692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.684658 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-token\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.684814 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.684769 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4flsp\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-kube-api-access-4flsp\") pod \"e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.840968 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.840869 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:12.987014 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.986988 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb"] Jul 06 01:51:12.988456 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:51:12.988419 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f456a6e_4d4f_4287_871f_0db77fc03072.slice/crio-794e78f7870f8cd03aa0bbeb001375b61d042ff53a1d51c3d7de66ccbd9dda3b WatchSource:0}: Error finding container 794e78f7870f8cd03aa0bbeb001375b61d042ff53a1d51c3d7de66ccbd9dda3b: Status 404 returned error can't find the container with id 794e78f7870f8cd03aa0bbeb001375b61d042ff53a1d51c3d7de66ccbd9dda3b Jul 06 01:51:12.990528 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.990494 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:12.990632 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.990577 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:12.990632 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:12.990622 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:13.015138 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:13.015110 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:13.451383 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:13.451336 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" event={"ID":"6f456a6e-4d4f-4287-871f-0db77fc03072","Type":"ContainerStarted","Data":"b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2"} Jul 06 01:51:13.451579 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:13.451408 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" event={"ID":"6f456a6e-4d4f-4287-871f-0db77fc03072","Type":"ContainerStarted","Data":"794e78f7870f8cd03aa0bbeb001375b61d042ff53a1d51c3d7de66ccbd9dda3b"} Jul 06 01:51:13.472834 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:13.472781 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podStartSLOduration=1.472766405 podStartE2EDuration="1.472766405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:51:13.470591137 +0000 UTC m=+1864.893394195" watchObservedRunningTime="2026-07-06 01:51:13.472766405 +0000 UTC m=+1864.895569459" Jul 06 01:51:13.841474 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:13.841384 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:14.854457 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:14.854412 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:15.432142 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:15.432100 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:15.463867 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:15.463835 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:15.464928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:15.464909 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:15.528104 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:15.528072 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:15.689220 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:15.689127 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:16.077294 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:16.077205 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:16.180106 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:16.180075 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:19.943106 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:19.943066 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:21.414868 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.414831 2571 patch_prober.go:28] interesting pod/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 01:51:21.415302 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.414887 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 01:51:21.498711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.498625 2571 generic.go:356] "Generic (PLEG): container finished" podID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerID="03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5" exitCode=0 Jul 06 01:51:21.498711 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.498677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" event={"ID":"2604b110-98f3-4ab3-b1ae-c766099e7379","Type":"ContainerDied","Data":"03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5"} Jul 06 01:51:21.499107 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.499093 2571 scope.go:117] "RemoveContainer" containerID="03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5" Jul 06 01:51:21.500120 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.500090 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:21.500188 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.500174 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:21.500228 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:21.500212 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:22.505913 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:22.505881 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" event={"ID":"2604b110-98f3-4ab3-b1ae-c766099e7379","Type":"ContainerStarted","Data":"44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d"} Jul 06 01:51:22.717997 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:22.717940 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:22.718238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:22.718217 2571 patch_prober.go:28] interesting pod/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 01:51:22.718315 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:22.718275 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 01:51:23.718667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:23.718565 2571 patch_prober.go:28] interesting pod/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 01:51:23.718667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:23.718631 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 01:51:24.718233 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:24.718192 2571 patch_prober.go:28] interesting pod/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 01:51:24.718456 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:24.718251 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 01:51:25.718407 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:25.718363 2571 patch_prober.go:28] interesting pod/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 01:51:25.718814 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:25.718448 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 01:51:26.722055 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:26.722028 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:26.722490 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:26.722436 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:26.723235 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:26.723216 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:51:27.535892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:27.535858 2571 generic.go:356] "Generic (PLEG): container finished" podID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerID="b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2" exitCode=0 Jul 06 01:51:27.536086 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:27.535933 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" event={"ID":"6f456a6e-4d4f-4287-871f-0db77fc03072","Type":"ContainerDied","Data":"b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2"} Jul 06 01:51:27.536490 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:27.536474 2571 scope.go:117] "RemoveContainer" containerID="b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2" Jul 06 01:51:27.537432 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:27.537405 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:27.537524 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:27.537472 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:27.537524 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:27.537509 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:51:28.558884 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:28.558823 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" event={"ID":"6f456a6e-4d4f-4287-871f-0db77fc03072","Type":"ContainerStarted","Data":"88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a"} Jul 06 01:51:28.609196 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:28.609145 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:28.709664 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:28.709632 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:28.842991 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:28.842326 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:28.843398 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:28.843353 2571 patch_prober.go:28] interesting pod/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 06 01:51:28.843596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:28.843564 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 06 01:51:29.842609 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:29.842167 2571 patch_prober.go:28] interesting pod/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 06 01:51:29.842609 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:29.842231 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 06 01:51:29.993790 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:29.993756 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:30.464342 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:30.464311 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:30.842273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:30.842174 2571 patch_prober.go:28] interesting pod/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 06 01:51:30.842575 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:30.842540 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 06 01:51:31.841421 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:31.841323 2571 patch_prober.go:28] interesting pod/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 06 01:51:31.842045 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:31.842014 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 06 01:51:32.845673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:32.845637 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:32.846495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:32.846477 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:51:37.551543 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:37.551511 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:37.652084 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:37.652028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:51:50.286847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:51:50.286793 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:08.201259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:08.201216 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:09.080378 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:09.080344 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:09.277305 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:09.277269 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:09.664555 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:09.664517 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:09.765001 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:09.764969 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:09.866028 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:09.865995 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:09.981781 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:09.981668 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:14.745136 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:14.745077 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:51.331135 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:51.331083 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:51.591318 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:51.591242 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc"] Jul 06 01:52:51.591468 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:51.591445 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" containerID="cri-o://44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d" gracePeriod=30 Jul 06 01:52:51.613342 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:51.613302 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:51.843639 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:51.843552 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:52.010565 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:52.010526 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:52.432616 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:52.432582 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:52.530597 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:52.530561 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:52.760265 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:52.760181 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:56.723895 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.723862 2571 patch_prober.go:28] interesting pod/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 01:52:56.724275 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.723919 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 01:52:56.850483 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.850459 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:52:56.945532 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945498 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-data\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.945742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945548 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-certs\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.945742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945596 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-credential-socket\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.945742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945621 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-envoy\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.945742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945648 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-socket\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.945742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945675 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmzx4\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-kube-api-access-qmzx4\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.945742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945721 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-podinfo\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.946079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945796 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2604b110-98f3-4ab3-b1ae-c766099e7379-istiod-ca-cert\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.946079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945825 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-token\") pod \"2604b110-98f3-4ab3-b1ae-c766099e7379\" (UID: \"2604b110-98f3-4ab3-b1ae-c766099e7379\") " Jul 06 01:52:56.946079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945905 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:52:56.946079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945929 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:52:56.946079 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.945939 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:52:56.946343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.946220 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:56.946343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.946232 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2604b110-98f3-4ab3-b1ae-c766099e7379-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:52:56.946343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.946242 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:56.946343 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.946257 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:56.946544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.946404 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-data" (OuterVolumeSpecName: "istio-data") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:52:56.947795 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.947772 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:52:56.947899 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.947844 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-token" (OuterVolumeSpecName: "istio-token") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:52:56.948737 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.948711 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-kube-api-access-qmzx4" (OuterVolumeSpecName: "kube-api-access-qmzx4") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "kube-api-access-qmzx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:52:56.948737 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:56.948726 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2604b110-98f3-4ab3-b1ae-c766099e7379" (UID: "2604b110-98f3-4ab3-b1ae-c766099e7379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:52:57.019137 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.019103 2571 generic.go:356] "Generic (PLEG): container finished" podID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerID="44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d" exitCode=0 Jul 06 01:52:57.019326 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.019151 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" Jul 06 01:52:57.019326 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.019193 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" event={"ID":"2604b110-98f3-4ab3-b1ae-c766099e7379","Type":"ContainerDied","Data":"44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d"} Jul 06 01:52:57.019326 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.019259 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc" event={"ID":"2604b110-98f3-4ab3-b1ae-c766099e7379","Type":"ContainerDied","Data":"0dbbce9a0ef88cbd5d15e16bbb67a8edd3602af09cedbb8da72d7afae549c779"} Jul 06 01:52:57.019326 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.019289 2571 scope.go:117] "RemoveContainer" containerID="44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d" Jul 06 01:52:57.028751 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.028730 2571 scope.go:117] "RemoveContainer" containerID="03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5" Jul 06 01:52:57.036387 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.036371 2571 scope.go:117] "RemoveContainer" containerID="44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d" Jul 06 01:52:57.036630 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:52:57.036613 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d\": container with ID starting with 44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d not found: ID does not exist" containerID="44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d" Jul 06 01:52:57.036673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.036637 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d"} err="failed to get container status \"44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d\": rpc error: code = NotFound desc = could not find container \"44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d\": container with ID starting with 44bc27b868a0c93ecfeddb578c3c7b61e4988269eec9664a1554faf5f1b0954d not found: ID does not exist" Jul 06 01:52:57.036673 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.036653 2571 scope.go:117] "RemoveContainer" containerID="03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5" Jul 06 01:52:57.036875 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:52:57.036855 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5\": container with ID starting with 03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5 not found: ID does not exist" containerID="03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5" Jul 06 01:52:57.036916 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.036881 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5"} err="failed to get container status \"03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5\": rpc error: code = NotFound desc = could not find container \"03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5\": container with ID starting with 03b6d95deeedff1f1948feff36abf1818758d88c6650be4fc2edd6f6634628a5 not found: ID does not exist" Jul 06 01:52:57.041193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.041171 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc"] Jul 06 01:52:57.046723 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.046703 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-03c9df-openshift-default-85b4b5f7c5-r67fc"] Jul 06 01:52:57.047185 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.047169 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2604b110-98f3-4ab3-b1ae-c766099e7379-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:57.047231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.047191 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:57.047231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.047200 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:57.047231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.047207 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:57.047231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.047216 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmzx4\" (UniqueName: \"kubernetes.io/projected/2604b110-98f3-4ab3-b1ae-c766099e7379-kube-api-access-qmzx4\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:57.047231 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.047224 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2604b110-98f3-4ab3-b1ae-c766099e7379-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:52:57.271748 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:57.271667 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" path="/var/lib/kubelet/pods/2604b110-98f3-4ab3-b1ae-c766099e7379/volumes" Jul 06 01:52:58.164293 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:58.164256 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:58.224361 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:58.224326 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:58.407167 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:58.407131 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb"] Jul 06 01:52:58.407419 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:58.407395 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" containerID="cri-o://88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a" gracePeriod=30 Jul 06 01:52:58.427561 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:58.427482 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:58.668826 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:58.668790 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:59.037583 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.037551 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:59.303935 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.303861 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr"] Jul 06 01:52:59.304421 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.304406 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" Jul 06 01:52:59.304467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.304425 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" Jul 06 01:52:59.304467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.304451 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" Jul 06 01:52:59.304467 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.304460 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" Jul 06 01:52:59.304567 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.304550 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" Jul 06 01:52:59.304567 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.304560 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2604b110-98f3-4ab3-b1ae-c766099e7379" containerName="istio-proxy" Jul 06 01:52:59.309513 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.309492 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.311890 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.311868 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-eb606b-openshift-default-dockercfg-d948q\"" Jul 06 01:52:59.318526 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.318505 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr"] Jul 06 01:52:59.332143 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.332115 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:59.368606 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368572 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a517d877-b471-491e-930b-b591d29e961a-istiod-ca-cert\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368606 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368606 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-certs\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-credential-socket\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368660 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-envoy\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368681 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a517d877-b471-491e-930b-b591d29e961a-istio-podinfo\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368700 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-istio-token\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368733 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kwp\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-kube-api-access-c9kwp\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368773 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-socket\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.368825 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.368801 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-data\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470286 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-credential-socket\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470286 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-envoy\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470554 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470314 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a517d877-b471-491e-930b-b591d29e961a-istio-podinfo\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470554 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470368 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-istio-token\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470554 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470418 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kwp\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-kube-api-access-c9kwp\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470543 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-socket\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470603 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-data\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470707 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a517d877-b471-491e-930b-b591d29e961a-istiod-ca-cert\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470736 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-certs\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.470869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470834 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-credential-socket\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.471005 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470883 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-socket\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.471005 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.470976 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-data\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.471109 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.471034 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-certs\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.471570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.471549 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a517d877-b471-491e-930b-b591d29e961a-istiod-ca-cert\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.473041 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.473020 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-envoy\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.473152 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.473132 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a517d877-b471-491e-930b-b591d29e961a-istio-podinfo\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.496068 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.496023 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-istio-token\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.498572 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.498548 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kwp\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-kube-api-access-c9kwp\") pod \"e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.621100 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.621013 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:52:59.683415 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.683338 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:52:59.757953 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.757913 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr"] Jul 06 01:52:59.758753 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:52:59.758734 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda517d877_b471_491e_930b_b591d29e961a.slice/crio-b174be05809e0b73186269a33238e9913258e6c7a246b5fa08e32fe28a76389d WatchSource:0}: Error finding container b174be05809e0b73186269a33238e9913258e6c7a246b5fa08e32fe28a76389d: Status 404 returned error can't find the container with id b174be05809e0b73186269a33238e9913258e6c7a246b5fa08e32fe28a76389d Jul 06 01:52:59.760617 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.760591 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:52:59.760691 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.760650 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:52:59.760691 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:52:59.760677 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:00.043230 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:00.043186 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" event={"ID":"a517d877-b471-491e-930b-b591d29e961a","Type":"ContainerStarted","Data":"9767d8b3fd4b81159b3ac17e6d46ee9fe267bdf4aeb103419e8a529d96471029"} Jul 06 01:53:00.043422 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:00.043259 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" event={"ID":"a517d877-b471-491e-930b-b591d29e961a","Type":"ContainerStarted","Data":"b174be05809e0b73186269a33238e9913258e6c7a246b5fa08e32fe28a76389d"} Jul 06 01:53:00.060735 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:00.060684 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podStartSLOduration=1.060663927 podStartE2EDuration="1.060663927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:53:00.059551952 +0000 UTC m=+1971.482355026" watchObservedRunningTime="2026-07-06 01:53:00.060663927 +0000 UTC m=+1971.483466985" Jul 06 01:53:00.621370 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:00.621341 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:00.626136 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:00.626113 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:01.048774 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:01.048737 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:01.049683 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:01.049667 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:01.976689 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:01.976658 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:02.062215 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.062184 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:02.135156 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.135123 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:02.516819 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.516784 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:02.626118 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.626083 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:02.726779 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.726746 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:02.848453 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.848357 2571 patch_prober.go:28] interesting pod/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 01:53:02.848453 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:02.848436 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:53:03.651460 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.651433 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:53:03.712273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712189 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4flsp\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-kube-api-access-4flsp\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712241 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-podinfo\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712273 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712264 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-data\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712279 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-token\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712330 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f456a6e-4d4f-4287-871f-0db77fc03072-istiod-ca-cert\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712359 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-certs\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712391 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-credential-socket\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712419 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-socket\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712544 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712450 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-envoy\") pod \"6f456a6e-4d4f-4287-871f-0db77fc03072\" (UID: \"6f456a6e-4d4f-4287-871f-0db77fc03072\") " Jul 06 01:53:03.712832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712670 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:03.712832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712791 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.712832 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.712796 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f456a6e-4d4f-4287-871f-0db77fc03072-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:53:03.713025 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.713012 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:03.713088 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.713073 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:03.713210 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.713189 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:03.714918 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.714891 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:53:03.715045 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.714916 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-kube-api-access-4flsp" (OuterVolumeSpecName: "kube-api-access-4flsp") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "kube-api-access-4flsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:53:03.715045 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.715035 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:03.715134 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.715046 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f456a6e-4d4f-4287-871f-0db77fc03072" (UID: "6f456a6e-4d4f-4287-871f-0db77fc03072"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:53:03.813847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813806 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4flsp\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-kube-api-access-4flsp\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.813847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813841 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.813847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813852 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.813847 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813860 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.814160 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813868 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f456a6e-4d4f-4287-871f-0db77fc03072-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.814160 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813876 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.814160 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813884 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:03.814160 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:03.813892 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f456a6e-4d4f-4287-871f-0db77fc03072-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:04.069682 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.069599 2571 generic.go:356] "Generic (PLEG): container finished" podID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerID="88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a" exitCode=0 Jul 06 01:53:04.069682 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.069652 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" Jul 06 01:53:04.069856 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.069687 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" event={"ID":"6f456a6e-4d4f-4287-871f-0db77fc03072","Type":"ContainerDied","Data":"88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a"} Jul 06 01:53:04.069856 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.069744 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb" event={"ID":"6f456a6e-4d4f-4287-871f-0db77fc03072","Type":"ContainerDied","Data":"794e78f7870f8cd03aa0bbeb001375b61d042ff53a1d51c3d7de66ccbd9dda3b"} Jul 06 01:53:04.069856 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.069773 2571 scope.go:117] "RemoveContainer" containerID="88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a" Jul 06 01:53:04.079665 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.079647 2571 scope.go:117] "RemoveContainer" containerID="b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2" Jul 06 01:53:04.087522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.087503 2571 scope.go:117] "RemoveContainer" containerID="88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a" Jul 06 01:53:04.087763 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:53:04.087739 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a\": container with ID starting with 88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a not found: ID does not exist" containerID="88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a" Jul 06 01:53:04.087864 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.087769 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a"} err="failed to get container status \"88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a\": rpc error: code = NotFound desc = could not find container \"88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a\": container with ID starting with 88e0265dadb11eb3de3efbeaec5759ff9d75f5578d38c00c286e84311362b44a not found: ID does not exist" Jul 06 01:53:04.087864 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.087786 2571 scope.go:117] "RemoveContainer" containerID="b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2" Jul 06 01:53:04.088077 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:53:04.088057 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2\": container with ID starting with b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2 not found: ID does not exist" containerID="b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2" Jul 06 01:53:04.088132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.088083 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2"} err="failed to get container status \"b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2\": rpc error: code = NotFound desc = could not find container \"b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2\": container with ID starting with b44f6df05c9db249ec234f8e7b6f27ab6287db63c3886c0923e649bb62fe75c2 not found: ID does not exist" Jul 06 01:53:04.092182 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.092151 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb"] Jul 06 01:53:04.095493 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:04.095472 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7c01b8-openshift-default-7fd68456cc-bjhzb"] Jul 06 01:53:05.271363 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:05.271332 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" path="/var/lib/kubelet/pods/6f456a6e-4d4f-4287-871f-0db77fc03072/volumes" Jul 06 01:53:06.483081 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:06.483048 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:06.934975 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:06.934921 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:07.227217 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.227140 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht"] Jul 06 01:53:07.227549 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.227533 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" Jul 06 01:53:07.227630 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.227553 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" Jul 06 01:53:07.227680 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.227672 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" Jul 06 01:53:07.232213 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.232186 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.234430 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.234408 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-43d931-openshift-default-dockercfg-sjcq4\"" Jul 06 01:53:07.243763 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.243740 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht"] Jul 06 01:53:07.258584 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.258560 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:07.348880 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.348817 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-socket\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.348890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf85x\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-kube-api-access-xf85x\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349022 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-data\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349239 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349098 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-credential-socket\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349239 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349164 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-token\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349346 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349260 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istiod-ca-cert\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349343 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-certs\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349402 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349393 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-envoy\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.349495 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.349438 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-podinfo\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.420466 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.420431 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:07.450703 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450676 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-socket\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.450883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450707 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf85x\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-kube-api-access-xf85x\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.450883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450738 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-data\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.450883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450789 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-credential-socket\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.450883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450813 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-token\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.450883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istiod-ca-cert\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.450883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450875 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-certs\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.451186 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450906 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-envoy\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.451556 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.451500 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-data\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.451653 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.451597 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-credential-socket\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.451653 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.451623 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-socket\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.451653 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.450961 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-podinfo\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.452069 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.452011 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-certs\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.457982 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.452350 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istiod-ca-cert\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.458637 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.458163 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-envoy\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.460874 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.460852 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-podinfo\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.461018 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.460996 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf85x\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-kube-api-access-xf85x\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.461669 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.461653 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-token\") pod \"e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.544021 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.543912 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:07.678059 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.678029 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht"] Jul 06 01:53:07.679258 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:53:07.679235 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3157955_3d04_43d3_99d3_7213ce1fb7d6.slice/crio-3940ad6fd0bdd7d9d93d1fef8e693a5c580cf4c2d75c8af16035eaed764d6d29 WatchSource:0}: Error finding container 3940ad6fd0bdd7d9d93d1fef8e693a5c580cf4c2d75c8af16035eaed764d6d29: Status 404 returned error can't find the container with id 3940ad6fd0bdd7d9d93d1fef8e693a5c580cf4c2d75c8af16035eaed764d6d29 Jul 06 01:53:07.681799 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.681769 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:07.681887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.681830 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:07.681887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:07.681859 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:08.092866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:08.092823 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" event={"ID":"c3157955-3d04-43d3-99d3-7213ce1fb7d6","Type":"ContainerStarted","Data":"b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1"} Jul 06 01:53:08.093112 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:08.092897 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" event={"ID":"c3157955-3d04-43d3-99d3-7213ce1fb7d6","Type":"ContainerStarted","Data":"3940ad6fd0bdd7d9d93d1fef8e693a5c580cf4c2d75c8af16035eaed764d6d29"} Jul 06 01:53:08.113785 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:08.113738 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podStartSLOduration=1.113722235 podStartE2EDuration="1.113722235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:53:08.112579267 +0000 UTC m=+1979.535382380" watchObservedRunningTime="2026-07-06 01:53:08.113722235 +0000 UTC m=+1979.536525288" Jul 06 01:53:08.544900 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:08.544861 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:08.550236 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:08.550211 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:09.098437 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:09.098404 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:09.099391 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:09.099367 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:10.031466 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:10.031439 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:10.112308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:10.112267 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:10.180372 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:10.180339 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:10.545160 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:10.545128 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:10.645066 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:10.645028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:10.745207 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:10.745167 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:14.509738 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:14.509701 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:17.090255 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:17.090207 2571 patch_prober.go:28] interesting pod/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 01:53:17.090770 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:17.090304 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 01:53:18.165221 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:18.165188 2571 generic.go:356] "Generic (PLEG): container finished" podID="a517d877-b471-491e-930b-b591d29e961a" containerID="9767d8b3fd4b81159b3ac17e6d46ee9fe267bdf4aeb103419e8a529d96471029" exitCode=0 Jul 06 01:53:18.165646 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:18.165258 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" event={"ID":"a517d877-b471-491e-930b-b591d29e961a","Type":"ContainerDied","Data":"9767d8b3fd4b81159b3ac17e6d46ee9fe267bdf4aeb103419e8a529d96471029"} Jul 06 01:53:18.165646 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:18.165621 2571 scope.go:117] "RemoveContainer" containerID="9767d8b3fd4b81159b3ac17e6d46ee9fe267bdf4aeb103419e8a529d96471029" Jul 06 01:53:18.166692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:18.166661 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:18.166794 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:18.166735 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:18.166794 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:18.166771 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:19.178122 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:19.178073 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" event={"ID":"a517d877-b471-491e-930b-b591d29e961a","Type":"ContainerStarted","Data":"077a438c1596a51cbbee217bc12b9add924030e77387110b92fbbfa3fa56e75e"} Jul 06 01:53:19.622498 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:19.622410 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:19.622654 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:19.622522 2571 patch_prober.go:28] interesting pod/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 01:53:19.622654 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:19.622567 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 01:53:20.622200 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:20.622161 2571 patch_prober.go:28] interesting pod/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 01:53:20.622588 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:20.622211 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 01:53:21.622061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:21.621974 2571 patch_prober.go:28] interesting pod/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 01:53:21.622061 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:21.622044 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 01:53:22.608631 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:22.608595 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:22.621827 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:22.621797 2571 patch_prober.go:28] interesting pod/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 01:53:22.622006 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:22.621851 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 01:53:23.000996 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.000959 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:23.102682 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.102643 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:23.202692 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.202648 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:23.275259 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.275157 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:23.625439 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.625355 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:23.625706 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.625681 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:23.626445 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:23.626426 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:24.342610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:24.342373 2571 patch_prober.go:28] interesting pod/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:52026->10.133.0.50:15021: read: connection reset by peer" start-of-body= Jul 06 01:53:24.342610 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:24.342456 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:52026->10.133.0.50:15021: read: connection reset by peer" Jul 06 01:53:25.212918 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:25.212886 2571 generic.go:356] "Generic (PLEG): container finished" podID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerID="b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1" exitCode=0 Jul 06 01:53:25.213124 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:25.212969 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" event={"ID":"c3157955-3d04-43d3-99d3-7213ce1fb7d6","Type":"ContainerDied","Data":"b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1"} Jul 06 01:53:25.213699 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:25.213684 2571 scope.go:117] "RemoveContainer" containerID="b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1" Jul 06 01:53:25.214576 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:25.214553 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:25.214637 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:25.214613 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:25.214683 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:25.214643 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:26.220304 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:26.220268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" event={"ID":"c3157955-3d04-43d3-99d3-7213ce1fb7d6","Type":"ContainerStarted","Data":"c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf"} Jul 06 01:53:26.544862 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:26.544760 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:26.545176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:26.545055 2571 patch_prober.go:28] interesting pod/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 01:53:26.545396 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:26.545371 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 01:53:27.545195 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:27.545156 2571 patch_prober.go:28] interesting pod/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 01:53:27.545803 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:27.545771 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 01:53:28.545249 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:28.545198 2571 patch_prober.go:28] interesting pod/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 01:53:28.545861 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:28.545828 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 01:53:28.825593 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:28.825514 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:28.920226 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:28.920195 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:29.115078 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.114989 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr"] Jul 06 01:53:29.118607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.118563 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" containerID="cri-o://077a438c1596a51cbbee217bc12b9add924030e77387110b92fbbfa3fa56e75e" gracePeriod=30 Jul 06 01:53:29.125539 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.125515 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:29.366658 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.366564 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:29.526724 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.526687 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:29.546725 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.546678 2571 patch_prober.go:28] interesting pod/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 01:53:29.547226 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.546771 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 01:53:29.625898 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.625806 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:29.998970 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:29.998909 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:30.101209 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:30.101172 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:30.200895 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:30.200862 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:30.295006 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:30.294906 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:30.548319 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:30.548236 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:30.548766 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:30.548609 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:30.549447 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:30.549429 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:34.265994 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.265928 2571 generic.go:356] "Generic (PLEG): container finished" podID="a517d877-b471-491e-930b-b591d29e961a" containerID="077a438c1596a51cbbee217bc12b9add924030e77387110b92fbbfa3fa56e75e" exitCode=0 Jul 06 01:53:34.265994 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.265980 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" event={"ID":"a517d877-b471-491e-930b-b591d29e961a","Type":"ContainerDied","Data":"077a438c1596a51cbbee217bc12b9add924030e77387110b92fbbfa3fa56e75e"} Jul 06 01:53:34.266522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.266047 2571 scope.go:117] "RemoveContainer" containerID="9767d8b3fd4b81159b3ac17e6d46ee9fe267bdf4aeb103419e8a529d96471029" Jul 06 01:53:34.394442 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.394415 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:34.526427 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526389 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-certs\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526448 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-istio-token\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526480 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kwp\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-kube-api-access-c9kwp\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526503 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-envoy\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526519 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-socket\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526607 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526573 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-data\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526820 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526622 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-credential-socket\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526820 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526664 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a517d877-b471-491e-930b-b591d29e961a-istio-podinfo\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.526820 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526744 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a517d877-b471-491e-930b-b591d29e961a-istiod-ca-cert\") pod \"a517d877-b471-491e-930b-b591d29e961a\" (UID: \"a517d877-b471-491e-930b-b591d29e961a\") " Jul 06 01:53:34.527150 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526742 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:34.527150 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.526906 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:34.527150 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.527032 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:34.527382 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.527271 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a517d877-b471-491e-930b-b591d29e961a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:53:34.527654 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.527630 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:34.528870 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.528847 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a517d877-b471-491e-930b-b591d29e961a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:53:34.529068 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.528911 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-kube-api-access-c9kwp" (OuterVolumeSpecName: "kube-api-access-c9kwp") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "kube-api-access-c9kwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:53:34.529260 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.529228 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:53:34.529260 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.529230 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a517d877-b471-491e-930b-b591d29e961a" (UID: "a517d877-b471-491e-930b-b591d29e961a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:34.627881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627830 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.627881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627874 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.627881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627884 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kwp\" (UniqueName: \"kubernetes.io/projected/a517d877-b471-491e-930b-b591d29e961a-kube-api-access-c9kwp\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.627881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627892 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.627881 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627900 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.628243 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627908 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.628243 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627918 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a517d877-b471-491e-930b-b591d29e961a-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.628243 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627926 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a517d877-b471-491e-930b-b591d29e961a-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:34.628243 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:34.627933 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a517d877-b471-491e-930b-b591d29e961a-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:35.278418 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.278390 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" Jul 06 01:53:35.278859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.278395 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr" event={"ID":"a517d877-b471-491e-930b-b591d29e961a","Type":"ContainerDied","Data":"b174be05809e0b73186269a33238e9913258e6c7a246b5fa08e32fe28a76389d"} Jul 06 01:53:35.278859 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.278517 2571 scope.go:117] "RemoveContainer" containerID="077a438c1596a51cbbee217bc12b9add924030e77387110b92fbbfa3fa56e75e" Jul 06 01:53:35.299545 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.299521 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr"] Jul 06 01:53:35.303797 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.303771 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-eb606b-openshift-default-6db4cfbc77-24mjr"] Jul 06 01:53:35.727863 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.727829 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:35.827424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.827393 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:35.969147 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.969102 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht"] Jul 06 01:53:35.969353 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.969327 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" containerID="cri-o://c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf" gracePeriod=30 Jul 06 01:53:35.991191 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:35.991107 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:36.237866 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.237820 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:36.557999 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.557965 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:36.962871 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.962838 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5"] Jul 06 01:53:36.963238 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963223 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" Jul 06 01:53:36.963283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963241 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" Jul 06 01:53:36.963283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963255 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" Jul 06 01:53:36.963283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963261 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" Jul 06 01:53:36.963283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963269 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" Jul 06 01:53:36.963283 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963275 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" Jul 06 01:53:36.963435 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963337 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f456a6e-4d4f-4287-871f-0db77fc03072" containerName="istio-proxy" Jul 06 01:53:36.963435 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.963349 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" Jul 06 01:53:36.965910 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.965895 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:36.968276 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.968252 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5afb9c-openshift-default-dockercfg-kxnlv\"" Jul 06 01:53:36.977459 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.977432 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:36.979371 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:36.979349 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5"] Jul 06 01:53:37.051515 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051468 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-data\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051708 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051543 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-envoy\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051708 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-credential-socket\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051815 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051709 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-certs\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051815 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8b2s\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-kube-api-access-n8b2s\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051848 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-podinfo\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051887 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-token\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.051928 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051914 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-socket\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.052128 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.051964 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istiod-ca-cert\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.152903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.152867 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-envoy\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.152903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.152915 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-credential-socket\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153027 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-certs\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153044 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8b2s\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-kube-api-access-n8b2s\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153094 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-podinfo\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153118 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-token\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153145 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-socket\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153203 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153176 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istiod-ca-cert\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153224 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-data\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153435 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-credential-socket\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153747 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153702 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-certs\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153747 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153717 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-socket\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153916 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153895 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-data\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.153998 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.153981 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istiod-ca-cert\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.155297 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.155276 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-envoy\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.155443 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.155421 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-podinfo\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.162388 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.162359 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-token\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.162510 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.162454 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8b2s\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-kube-api-access-n8b2s\") pod \"e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.272094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.271981 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a517d877-b471-491e-930b-b591d29e961a" path="/var/lib/kubelet/pods/a517d877-b471-491e-930b-b591d29e961a/volumes" Jul 06 01:53:37.276429 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.276406 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:37.341903 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.341866 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:37.416595 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.416567 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5"] Jul 06 01:53:37.417970 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:53:37.417922 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod339b7b2b_7b6d_42a1_92e6_fb3cfc142db9.slice/crio-08555cbe6d1a164d8c43f18cb7dd231edb07929cab9a07c3c2aa4fb2d8734def WatchSource:0}: Error finding container 08555cbe6d1a164d8c43f18cb7dd231edb07929cab9a07c3c2aa4fb2d8734def: Status 404 returned error can't find the container with id 08555cbe6d1a164d8c43f18cb7dd231edb07929cab9a07c3c2aa4fb2d8734def Jul 06 01:53:37.420176 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.420147 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:37.420291 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.420224 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:37.420291 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:37.420269 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:38.299351 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:38.299311 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" event={"ID":"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9","Type":"ContainerStarted","Data":"8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff"} Jul 06 01:53:38.299739 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:38.299379 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" event={"ID":"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9","Type":"ContainerStarted","Data":"08555cbe6d1a164d8c43f18cb7dd231edb07929cab9a07c3c2aa4fb2d8734def"} Jul 06 01:53:38.321547 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:38.321495 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" podStartSLOduration=2.321479567 podStartE2EDuration="2.321479567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:53:38.318733988 +0000 UTC m=+2009.741537033" watchObservedRunningTime="2026-07-06 01:53:38.321479567 +0000 UTC m=+2009.744282620" Jul 06 01:53:39.276867 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:39.276840 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:39.281638 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:39.281612 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:39.307430 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:39.307395 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:39.310222 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:39.310198 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:40.252980 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:40.252930 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:40.348125 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:40.348086 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:40.412590 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:40.412553 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:40.703693 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:40.703654 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:40.805012 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:40.804972 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:40.905719 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:40.905684 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:41.230056 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.229997 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:41.320470 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.320433 2571 generic.go:356] "Generic (PLEG): container finished" podID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerID="c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf" exitCode=0 Jul 06 01:53:41.320634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.320486 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" Jul 06 01:53:41.320634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.320516 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" event={"ID":"c3157955-3d04-43d3-99d3-7213ce1fb7d6","Type":"ContainerDied","Data":"c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf"} Jul 06 01:53:41.320634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.320588 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht" event={"ID":"c3157955-3d04-43d3-99d3-7213ce1fb7d6","Type":"ContainerDied","Data":"3940ad6fd0bdd7d9d93d1fef8e693a5c580cf4c2d75c8af16035eaed764d6d29"} Jul 06 01:53:41.320634 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.320625 2571 scope.go:117] "RemoveContainer" containerID="c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf" Jul 06 01:53:41.329633 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.329616 2571 scope.go:117] "RemoveContainer" containerID="b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1" Jul 06 01:53:41.337600 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.337577 2571 scope.go:117] "RemoveContainer" containerID="c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf" Jul 06 01:53:41.337842 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:53:41.337816 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf\": container with ID starting with c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf not found: ID does not exist" containerID="c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf" Jul 06 01:53:41.337887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.337851 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf"} err="failed to get container status \"c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf\": rpc error: code = NotFound desc = could not find container \"c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf\": container with ID starting with c5213c2ceff516b110a1a2b7aca09f5136a5d5d87f78f47e6963da7339a2adcf not found: ID does not exist" Jul 06 01:53:41.337887 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.337868 2571 scope.go:117] "RemoveContainer" containerID="b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1" Jul 06 01:53:41.338106 ip-10-0-134-152 kubenswrapper[2571]: E0706 01:53:41.338087 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1\": container with ID starting with b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1 not found: ID does not exist" containerID="b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1" Jul 06 01:53:41.338169 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.338115 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1"} err="failed to get container status \"b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1\": rpc error: code = NotFound desc = could not find container \"b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1\": container with ID starting with b1bd678dd938f7254e23e5893c0c28b72331ece5c837aa45fc4378d100cab3c1 not found: ID does not exist" Jul 06 01:53:41.390466 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390435 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-data\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.390848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390490 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-credential-socket\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.390848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390521 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-socket\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.390848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390558 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf85x\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-kube-api-access-xf85x\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.390848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390582 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-podinfo\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.390848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390788 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-certs\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.390848 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390811 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:41.391193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390825 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-envoy\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.391193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390870 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:41.391193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.390904 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istiod-ca-cert\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.391193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391013 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-token\") pod \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\" (UID: \"c3157955-3d04-43d3-99d3-7213ce1fb7d6\") " Jul 06 01:53:41.391193 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391042 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:41.391462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391260 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:53:41.391462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391367 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:41.391462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391405 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.391462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391422 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.391462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391436 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.391462 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.391449 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.393067 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.393042 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:53:41.393164 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.393082 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:53:41.393304 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.393287 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:53:41.393367 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.393351 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-kube-api-access-xf85x" (OuterVolumeSpecName: "kube-api-access-xf85x") pod "c3157955-3d04-43d3-99d3-7213ce1fb7d6" (UID: "c3157955-3d04-43d3-99d3-7213ce1fb7d6"). InnerVolumeSpecName "kube-api-access-xf85x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:53:41.492728 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.492640 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.492728 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.492667 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf85x\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-kube-api-access-xf85x\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.492728 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.492677 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.492728 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.492686 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.492728 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.492695 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3157955-3d04-43d3-99d3-7213ce1fb7d6-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:53:41.643643 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.643612 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht"] Jul 06 01:53:41.647574 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:41.647546 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-43d931-openshift-default-5c5bbbb49-q7vht"] Jul 06 01:53:43.270668 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:43.270636 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" path="/var/lib/kubelet/pods/c3157955-3d04-43d3-99d3-7213ce1fb7d6/volumes" Jul 06 01:53:44.791410 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:44.791367 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:45.121456 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.121352 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:45.445094 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.445062 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67"] Jul 06 01:53:45.445532 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.445513 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" Jul 06 01:53:45.445639 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.445536 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" Jul 06 01:53:45.445639 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.445636 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" Jul 06 01:53:45.445743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.445648 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a517d877-b471-491e-930b-b591d29e961a" containerName="istio-proxy" Jul 06 01:53:45.445743 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.445660 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" Jul 06 01:53:45.447817 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.447797 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.450431 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.450409 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ed9e8f-openshift-default-dockercfg-lglf2\"" Jul 06 01:53:45.459083 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.459059 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67"] Jul 06 01:53:45.480440 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.480396 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:45.530691 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.530651 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-podinfo\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.530869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.530701 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjk2x\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-kube-api-access-wjk2x\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.530869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.530789 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-token\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.530869 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.530830 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-data\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.531044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.530923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-certs\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.531044 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.531015 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istiod-ca-cert\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.531132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.531046 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-socket\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.531132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.531070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-credential-socket\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.531132 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.531105 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-envoy\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632635 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632602 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-certs\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632656 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istiod-ca-cert\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632685 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-socket\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632701 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-credential-socket\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632725 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-envoy\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-podinfo\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.632829 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632817 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjk2x\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-kube-api-access-wjk2x\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632852 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-token\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.632879 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-data\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.633071 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-certs\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633179 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.633077 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-socket\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633385 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.633283 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-data\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633702 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.633678 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istiod-ca-cert\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.633906 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.633784 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-credential-socket\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.635883 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.635859 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-envoy\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.636158 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.636111 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-podinfo\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.642237 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.642188 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-token\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.642363 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.642272 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjk2x\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-kube-api-access-wjk2x\") pod \"e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.679460 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.679426 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:45.759408 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.759314 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:45.896742 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.896717 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67"] Jul 06 01:53:45.898151 ip-10-0-134-152 kubenswrapper[2571]: W0706 01:53:45.898118 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861dac04_cbe7_4e34_b0d1_e937ea4f65a4.slice/crio-2e1c5be2ecef28196262897a4d3de19215846de323d1109d5fef4c194e89a3e1 WatchSource:0}: Error finding container 2e1c5be2ecef28196262897a4d3de19215846de323d1109d5fef4c194e89a3e1: Status 404 returned error can't find the container with id 2e1c5be2ecef28196262897a4d3de19215846de323d1109d5fef4c194e89a3e1 Jul 06 01:53:45.900266 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.900232 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:45.900349 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.900298 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:45.900349 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:45.900326 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:46.349994 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:46.349954 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" event={"ID":"861dac04-cbe7-4e34-b0d1-e937ea4f65a4","Type":"ContainerStarted","Data":"3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561"} Jul 06 01:53:46.350150 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:46.350016 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" event={"ID":"861dac04-cbe7-4e34-b0d1-e937ea4f65a4","Type":"ContainerStarted","Data":"2e1c5be2ecef28196262897a4d3de19215846de323d1109d5fef4c194e89a3e1"} Jul 06 01:53:46.372570 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:46.372506 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podStartSLOduration=1.3724853320000001 podStartE2EDuration="1.372485332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:53:46.369061941 +0000 UTC m=+2017.791865022" watchObservedRunningTime="2026-07-06 01:53:46.372485332 +0000 UTC m=+2017.795288388" Jul 06 01:53:46.760200 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:46.760150 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:46.765531 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:46.765513 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:47.357763 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:47.357730 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:47.358586 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:47.358566 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:53:48.319522 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:48.319489 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:48.400262 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:48.400228 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:48.472264 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:48.472233 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:48.572782 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:48.572675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:48.886973 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:48.886859 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:48.986818 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:48.986784 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:50.838189 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:50.838096 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:50.938892 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:50.938861 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:52.872596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:52.872552 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:53:53.390327 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:53.390294 2571 generic.go:356] "Generic (PLEG): container finished" podID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerID="8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff" exitCode=0 Jul 06 01:53:53.390535 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:53.390362 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" event={"ID":"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9","Type":"ContainerDied","Data":"8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff"} Jul 06 01:53:53.390785 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:53.390771 2571 scope.go:117] "RemoveContainer" containerID="8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff" Jul 06 01:53:53.391812 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:53.391784 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:53.391913 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:53.391894 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:53.391983 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:53.391962 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:53:54.307234 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:54.307193 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:54.397509 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:54.397472 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" event={"ID":"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9","Type":"ContainerStarted","Data":"e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999"} Jul 06 01:53:55.277727 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:55.277694 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:55.278861 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:55.278835 2571 patch_prober.go:28] interesting pod/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 01:53:55.279092 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:55.279066 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 01:53:56.277276 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:56.277235 2571 patch_prober.go:28] interesting pod/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 01:53:56.277888 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:56.277854 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 01:53:57.277671 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:57.277621 2571 patch_prober.go:28] interesting pod/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 01:53:57.278225 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:57.277689 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 01:53:58.281232 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:58.281199 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:58.281621 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:58.281575 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:53:58.282322 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:53:58.282302 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:54:01.483971 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:01.483915 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:01.584448 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:01.584399 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:02.359353 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.359321 2571 patch_prober.go:28] interesting pod/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 01:54:02.359559 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.359378 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 01:54:02.445864 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.445829 2571 generic.go:356] "Generic (PLEG): container finished" podID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerID="3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561" exitCode=0 Jul 06 01:54:02.446064 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.445873 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" event={"ID":"861dac04-cbe7-4e34-b0d1-e937ea4f65a4","Type":"ContainerDied","Data":"3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561"} Jul 06 01:54:02.446310 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.446295 2571 scope.go:117] "RemoveContainer" containerID="3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561" Jul 06 01:54:02.447344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.447318 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:54:02.447404 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.447384 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:54:02.447440 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.447419 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 06 01:54:02.507385 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:02.507124 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:03.457667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:03.457624 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" event={"ID":"861dac04-cbe7-4e34-b0d1-e937ea4f65a4","Type":"ContainerStarted","Data":"56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5"} Jul 06 01:54:03.759777 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:03.759690 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:54:03.760303 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:03.760274 2571 patch_prober.go:28] interesting pod/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 01:54:03.760492 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:03.760462 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 01:54:04.760361 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:04.760316 2571 patch_prober.go:28] interesting pod/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 01:54:04.760857 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:04.760400 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 01:54:05.760443 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:05.760398 2571 patch_prober.go:28] interesting pod/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 01:54:05.760867 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:05.760471 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 01:54:06.760344 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:06.760304 2571 patch_prober.go:28] interesting pod/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 01:54:06.760546 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:06.760364 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 01:54:07.764443 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:07.764409 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:54:07.764938 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:07.764804 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:54:07.765432 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:07.765413 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 01:54:09.559630 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:09.559534 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:09.660695 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:09.660652 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:17.687174 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:17.687133 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:17.745300 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:17.745263 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:33.471093 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:33.471010 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:54:39.374555 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:54:39.374507 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:55:09.193347 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:55:09.193318 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:55:09.196485 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:55:09.196464 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 01:56:38.004482 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:56:38.004444 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:56:39.216287 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:56:39.216253 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:56:49.594992 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:56:49.594955 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:57:10.604006 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:57:10.603940 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:57:58.080757 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:57:58.080720 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:57:58.990284 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:57:58.990257 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:58:05.373308 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:58:05.373273 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:58:30.289424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:58:30.289395 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:58:46.690556 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:58:46.690522 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:58:51.529024 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:58:51.528982 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:58:51.634233 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:58:51.634194 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:02.164596 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:02.164559 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:02.264159 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:02.264127 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:04.529969 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:04.529920 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:09.865002 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:09.864961 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:10.266234 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:10.266191 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:10.369137 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:10.369098 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:10.693138 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:10.693108 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:11.758007 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:11.757966 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:12.173328 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:12.173287 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:12.271818 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:12.271785 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:12.374536 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:12.374502 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:12.476966 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:12.476873 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:17.252667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:17.252631 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:54.103851 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:54.103815 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:54.352355 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:54.352322 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5"] Jul 06 01:59:54.352568 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:54.352541 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" containerID="cri-o://e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999" gracePeriod=30 Jul 06 01:59:54.373842 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:54.373771 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:54.605003 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:54.604929 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:54.769640 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:54.769606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:55.184429 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:55.184400 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:55.285115 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:55.285077 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:55.437700 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:55.437614 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 01:59:58.284382 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:58.284347 2571 patch_prober.go:28] interesting pod/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 01:59:58.284761 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:58.284411 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:59:59.599664 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.599642 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 01:59:59.688667 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688643 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-certs\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.688860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688685 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istiod-ca-cert\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.688860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688717 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-credential-socket\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.688860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688744 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-token\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.688860 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688823 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-socket\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.689111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688872 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-envoy\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.689111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688900 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-podinfo\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.689111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688931 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-data\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.689111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.688997 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:59:59.689111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689028 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8b2s\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-kube-api-access-n8b2s\") pod \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\" (UID: \"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9\") " Jul 06 01:59:59.689111 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689077 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:59:59.689424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689171 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:59:59.689424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689203 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:59:59.689424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689373 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.689424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689391 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.689424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689403 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.689424 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689417 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.689904 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.689884 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-data" (OuterVolumeSpecName: "istio-data") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:59:59.691091 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.691071 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 01:59:59.691164 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.691097 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:59:59.691356 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.691336 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-token" (OuterVolumeSpecName: "istio-token") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:59:59.691399 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.691359 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-kube-api-access-n8b2s" (OuterVolumeSpecName: "kube-api-access-n8b2s") pod "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" (UID: "339b7b2b-7b6d-42a1-92e6-fb3cfc142db9"). InnerVolumeSpecName "kube-api-access-n8b2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:59:59.790256 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.790219 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.790256 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.790247 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.790256 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.790260 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8b2s\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-kube-api-access-n8b2s\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.790477 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.790272 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 01:59:59.790477 ip-10-0-134-152 kubenswrapper[2571]: I0706 01:59:59.790283 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:00.303076 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.303047 2571 generic.go:356] "Generic (PLEG): container finished" podID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerID="e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999" exitCode=0 Jul 06 02:00:00.303264 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.303091 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" Jul 06 02:00:00.303264 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.303111 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" event={"ID":"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9","Type":"ContainerDied","Data":"e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999"} Jul 06 02:00:00.303264 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.303147 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5" event={"ID":"339b7b2b-7b6d-42a1-92e6-fb3cfc142db9","Type":"ContainerDied","Data":"08555cbe6d1a164d8c43f18cb7dd231edb07929cab9a07c3c2aa4fb2d8734def"} Jul 06 02:00:00.303264 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.303168 2571 scope.go:117] "RemoveContainer" containerID="e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999" Jul 06 02:00:00.312936 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.312914 2571 scope.go:117] "RemoveContainer" containerID="8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff" Jul 06 02:00:00.320477 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.320460 2571 scope.go:117] "RemoveContainer" containerID="e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999" Jul 06 02:00:00.320725 ip-10-0-134-152 kubenswrapper[2571]: E0706 02:00:00.320708 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999\": container with ID starting with e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999 not found: ID does not exist" containerID="e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999" Jul 06 02:00:00.320770 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.320734 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999"} err="failed to get container status \"e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999\": rpc error: code = NotFound desc = could not find container \"e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999\": container with ID starting with e542c1dded6f985d748c56bf71d6c6d70bb9dfe45a76a7330a3936b629546999 not found: ID does not exist" Jul 06 02:00:00.320770 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.320748 2571 scope.go:117] "RemoveContainer" containerID="8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff" Jul 06 02:00:00.320974 ip-10-0-134-152 kubenswrapper[2571]: E0706 02:00:00.320956 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff\": container with ID starting with 8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff not found: ID does not exist" containerID="8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff" Jul 06 02:00:00.321023 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.320982 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff"} err="failed to get container status \"8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff\": rpc error: code = NotFound desc = could not find container \"8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff\": container with ID starting with 8816bbb8df8afdef82133eefde9814f9314a4212106d6c3893634067703c9dff not found: ID does not exist" Jul 06 02:00:00.325301 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.325280 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5"] Jul 06 02:00:00.328747 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:00.328727 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5afb9c-openshift-default-f557959cf-tqrh5"] Jul 06 02:00:01.219371 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.219335 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:01.271533 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.271506 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" path="/var/lib/kubelet/pods/339b7b2b-7b6d-42a1-92e6-fb3cfc142db9/volumes" Jul 06 02:00:01.402067 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.402032 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:01.465126 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.465093 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67"] Jul 06 02:00:01.465342 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.465321 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" containerID="cri-o://56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5" gracePeriod=30 Jul 06 02:00:01.516990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.516875 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:01.713421 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:01.713383 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:06.704866 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.704841 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 02:00:06.852856 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.852765 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-token\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.852856 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.852836 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-socket\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.852861 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjk2x\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-kube-api-access-wjk2x\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.852891 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istiod-ca-cert\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.852911 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-podinfo\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.852931 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-credential-socket\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853020 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-certs\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853040 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-envoy\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853122 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853065 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-data\") pod \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\" (UID: \"861dac04-cbe7-4e34-b0d1-e937ea4f65a4\") " Jul 06 02:00:06.853499 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853250 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 02:00:06.853499 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853294 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 02:00:06.853499 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853354 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 02:00:06.853499 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853361 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.853499 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853399 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-credential-socket\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.853731 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.853507 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 02:00:06.854090 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.854071 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 02:00:06.855535 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.855511 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 02:00:06.855675 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.855655 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 02:00:06.855730 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.855674 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-kube-api-access-wjk2x" (OuterVolumeSpecName: "kube-api-access-wjk2x") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "kube-api-access-wjk2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 02:00:06.855730 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.855661 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "861dac04-cbe7-4e34-b0d1-e937ea4f65a4" (UID: "861dac04-cbe7-4e34-b0d1-e937ea4f65a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 02:00:06.954763 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954724 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-workload-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.954763 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954756 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-envoy\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.954763 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954767 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.955041 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954777 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.955041 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954791 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjk2x\" (UniqueName: \"kubernetes.io/projected/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-kube-api-access-wjk2x\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.955041 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954802 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istiod-ca-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:06.955041 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:06.954813 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861dac04-cbe7-4e34-b0d1-e937ea4f65a4-istio-podinfo\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\"" Jul 06 02:00:07.340106 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.340076 2571 generic.go:356] "Generic (PLEG): container finished" podID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerID="56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5" exitCode=0 Jul 06 02:00:07.340256 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.340127 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" Jul 06 02:00:07.340256 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.340164 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" event={"ID":"861dac04-cbe7-4e34-b0d1-e937ea4f65a4","Type":"ContainerDied","Data":"56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5"} Jul 06 02:00:07.340256 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.340224 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67" event={"ID":"861dac04-cbe7-4e34-b0d1-e937ea4f65a4","Type":"ContainerDied","Data":"2e1c5be2ecef28196262897a4d3de19215846de323d1109d5fef4c194e89a3e1"} Jul 06 02:00:07.340398 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.340256 2571 scope.go:117] "RemoveContainer" containerID="56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5" Jul 06 02:00:07.351263 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.351216 2571 scope.go:117] "RemoveContainer" containerID="3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561" Jul 06 02:00:07.358349 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.358323 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67"] Jul 06 02:00:07.360186 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.360173 2571 scope.go:117] "RemoveContainer" containerID="56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5" Jul 06 02:00:07.360511 ip-10-0-134-152 kubenswrapper[2571]: E0706 02:00:07.360464 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5\": container with ID starting with 56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5 not found: ID does not exist" containerID="56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5" Jul 06 02:00:07.360606 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.360520 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5"} err="failed to get container status \"56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5\": rpc error: code = NotFound desc = could not find container \"56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5\": container with ID starting with 56c97119020424d9230cbd7ee5b5010c1b83f975a7e0c7e93892d0d7452a36c5 not found: ID does not exist" Jul 06 02:00:07.360606 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.360544 2571 scope.go:117] "RemoveContainer" containerID="3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561" Jul 06 02:00:07.360774 ip-10-0-134-152 kubenswrapper[2571]: E0706 02:00:07.360757 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561\": container with ID starting with 3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561 not found: ID does not exist" containerID="3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561" Jul 06 02:00:07.360815 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.360777 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561"} err="failed to get container status \"3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561\": rpc error: code = NotFound desc = could not find container \"3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561\": container with ID starting with 3812de6f53f6b0baac42ee1ea0bdd6f0d468a43558a63082ad99b6110952c561 not found: ID does not exist" Jul 06 02:00:07.362083 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.362062 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ed9e8f-openshift-default-788b79bbd7-d2v67"] Jul 06 02:00:07.600434 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:07.600353 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721705-l7zkp_a629ae47-8473-4c52-8ebb-d93268921a19/cleanup/0.log" Jul 06 02:00:08.253480 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:08.253453 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d8fbf9755-bx6zd_052c5c48-1883-4235-97fe-8c4393b1e12c/copy-manifests/0.log" Jul 06 02:00:08.260056 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:08.260010 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d8fbf9755-bx6zd_052c5c48-1883-4235-97fe-8c4393b1e12c/manager/0.log" Jul 06 02:00:09.224796 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.224760 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 02:00:09.229827 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.229805 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 02:00:09.271937 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.271904 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" path="/var/lib/kubelet/pods/861dac04-cbe7-4e34-b0d1-e937ea4f65a4/volumes" Jul 06 02:00:09.374683 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.374657 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k_4d783263-7570-4e19-8ff7-b64f60542547/extract/0.log" Jul 06 02:00:09.381616 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.381599 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k_4d783263-7570-4e19-8ff7-b64f60542547/util/0.log" Jul 06 02:00:09.387978 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.387959 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k_4d783263-7570-4e19-8ff7-b64f60542547/pull/0.log" Jul 06 02:00:09.498648 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.498570 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq_879d37c3-5e16-46f2-a595-6a878827c6e2/util/0.log" Jul 06 02:00:09.506549 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.506530 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq_879d37c3-5e16-46f2-a595-6a878827c6e2/pull/0.log" Jul 06 02:00:09.513105 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.513090 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq_879d37c3-5e16-46f2-a595-6a878827c6e2/extract/0.log" Jul 06 02:00:09.621277 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.621250 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd_798d47b7-171b-4941-ac3c-dae21fc6ad70/util/0.log" Jul 06 02:00:09.627412 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.627390 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd_798d47b7-171b-4941-ac3c-dae21fc6ad70/pull/0.log" Jul 06 02:00:09.633265 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.633249 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd_798d47b7-171b-4941-ac3c-dae21fc6ad70/extract/0.log" Jul 06 02:00:09.750365 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.750294 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4_80c44866-8940-4e80-b8c5-60e11dacc8f1/util/0.log" Jul 06 02:00:09.757068 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.757048 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4_80c44866-8940-4e80-b8c5-60e11dacc8f1/pull/0.log" Jul 06 02:00:09.763834 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:09.763814 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4_80c44866-8940-4e80-b8c5-60e11dacc8f1/extract/0.log" Jul 06 02:00:11.035713 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:11.035682 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dqjdg_fc10789b-4990-4cb3-b629-07e8fd506dbb/istio-proxy/0.log" Jul 06 02:00:11.148388 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:11.148355 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vdpzn_9b42bdba-14c6-48c7-900f-821da4248364/discovery/0.log" Jul 06 02:00:11.478075 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:11.478032 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/1.log" Jul 06 02:00:11.588631 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:11.588599 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2tjjf_bfa6daad-1ab3-4012-b6b7-309ed5446513/payload-pre-processing/0.log" Jul 06 02:00:11.805901 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:11.805824 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6c8bb4bf-h6nxl_df104202-ae4e-4716-869d-ac91e7b6c754/router/0.log" Jul 06 02:00:12.131706 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:12.131632 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hsf4f_8a3f6381-6f68-40ee-b712-a3929d775764/main/0.log" Jul 06 02:00:12.243119 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:12.243092 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-h9n4h_29acbdc1-a3f4-44b7-9118-26e8ff6d3d50/main/0.log" Jul 06 02:00:16.689092 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:16.689058 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:16.768641 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:16.768608 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:19.703380 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:19.703328 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pp2g5_81916daf-c70e-4cf0-afbc-6f9e5806ba00/global-pull-secret-syncer/0.log" Jul 06 02:00:19.747538 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:19.747512 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" Jul 06 02:00:19.865740 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:19.865710 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-152.ec2.internal_6510e963d2c0197b770e28d3db5696cd/haproxy/0.log" Jul 06 02:00:19.907066 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:19.907032 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hq2kt_d95d447d-2ac0-4646-b14e-6b4d6fc43d5c/konnectivity-agent/0.log" limit=1024 Jul 06 02:00:23.740264 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.740233 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k_4d783263-7570-4e19-8ff7-b64f60542547/extract/0.log" Jul 06 02:00:23.755964 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.755932 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k_4d783263-7570-4e19-8ff7-b64f60542547/util/0.log" Jul 06 02:00:23.778002 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.777972 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x7f2k_4d783263-7570-4e19-8ff7-b64f60542547/pull/0.log" Jul 06 02:00:23.803339 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.803318 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq_879d37c3-5e16-46f2-a595-6a878827c6e2/extract/0.log" Jul 06 02:00:23.824659 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.824628 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq_879d37c3-5e16-46f2-a595-6a878827c6e2/util/0.log" Jul 06 02:00:23.845133 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.845107 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02whnq_879d37c3-5e16-46f2-a595-6a878827c6e2/pull/0.log" Jul 06 02:00:23.874660 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.874638 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd_798d47b7-171b-4941-ac3c-dae21fc6ad70/extract/0.log" Jul 06 02:00:23.897154 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.897126 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd_798d47b7-171b-4941-ac3c-dae21fc6ad70/util/0.log" Jul 06 02:00:23.915699 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.915675 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355mxd_798d47b7-171b-4941-ac3c-dae21fc6ad70/pull/0.log" Jul 06 02:00:23.947291 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.947263 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4_80c44866-8940-4e80-b8c5-60e11dacc8f1/extract/0.log" Jul 06 02:00:23.976525 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:23.976492 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4_80c44866-8940-4e80-b8c5-60e11dacc8f1/util/0.log" Jul 06 02:00:24.001317 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:24.001214 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q2nt4_80c44866-8940-4e80-b8c5-60e11dacc8f1/pull/0.log" Jul 06 02:00:26.737294 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:26.737261 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-6t92h_c15a41a7-ff32-40f5-a8eb-d01874588ac5/cluster-monitoring-operator/0.log" Jul 06 02:00:26.867516 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:26.867485 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-jqhcg_f94e957d-a08d-49e1-bcb5-217e8041dd29/monitoring-plugin/0.log" Jul 06 02:00:26.975114 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:26.975091 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mnnhh_fc9ea35c-d37e-4494-b4b8-8dc1e43bda53/node-exporter/0.log" Jul 06 02:00:26.996775 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:26.996704 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mnnhh_fc9ea35c-d37e-4494-b4b8-8dc1e43bda53/kube-rbac-proxy/0.log" Jul 06 02:00:27.023152 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:27.023130 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mnnhh_fc9ea35c-d37e-4494-b4b8-8dc1e43bda53/init-textfile/0.log" Jul 06 02:00:27.478929 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:27.478899 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-744d46645f-c9sx5_e16a91f4-66ef-4051-85c8-6561dc5f7447/telemeter-client/0.log" Jul 06 02:00:27.512126 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:27.512097 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-744d46645f-c9sx5_e16a91f4-66ef-4051-85c8-6561dc5f7447/reload/0.log" Jul 06 02:00:27.532895 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:27.532868 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-744d46645f-c9sx5_e16a91f4-66ef-4051-85c8-6561dc5f7447/kube-rbac-proxy/0.log" Jul 06 02:00:29.619315 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:29.619281 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-522fr_5fc3422c-f065-4485-9b06-13c101fbb3f4/console-operator/0.log" Jul 06 02:00:30.449445 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449413 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz"] Jul 06 02:00:30.449744 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449732 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" Jul 06 02:00:30.449791 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449746 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" Jul 06 02:00:30.449791 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449755 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" Jul 06 02:00:30.449791 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449761 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" Jul 06 02:00:30.449791 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449772 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" Jul 06 02:00:30.449791 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449780 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" Jul 06 02:00:30.449791 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449791 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" Jul 06 02:00:30.449990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449796 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3157955-3d04-43d3-99d3-7213ce1fb7d6" containerName="istio-proxy" Jul 06 02:00:30.449990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449802 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" Jul 06 02:00:30.449990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449807 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" Jul 06 02:00:30.449990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449854 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" Jul 06 02:00:30.449990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449862 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="861dac04-cbe7-4e34-b0d1-e937ea4f65a4" containerName="istio-proxy" Jul 06 02:00:30.449990 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.449870 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="339b7b2b-7b6d-42a1-92e6-fb3cfc142db9" containerName="istio-proxy" Jul 06 02:00:30.452669 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.452649 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.455191 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.455168 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hqwmc\"/\"openshift-service-ca.crt\"" Jul 06 02:00:30.455281 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.455199 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hqwmc\"/\"default-dockercfg-5sss8\"" Jul 06 02:00:30.455878 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.455865 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hqwmc\"/\"kube-root-ca.crt\"" Jul 06 02:00:30.462550 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.462528 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz"] Jul 06 02:00:30.569673 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.569634 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-proc\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.569673 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.569678 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-sys\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.569934 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.569723 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jgxh\" (UniqueName: \"kubernetes.io/projected/d450c4c1-e295-479c-9064-1fec8454e2e1-kube-api-access-9jgxh\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.569934 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.569794 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-podres\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.569934 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.569835 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-lib-modules\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.670528 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670485 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jgxh\" (UniqueName: \"kubernetes.io/projected/d450c4c1-e295-479c-9064-1fec8454e2e1-kube-api-access-9jgxh\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.670528 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670533 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-podres\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-podres\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670662 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-lib-modules\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-proc\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670814 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-lib-modules\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670842 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-sys\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670868 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-proc\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.671081 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.670986 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d450c4c1-e295-479c-9064-1fec8454e2e1-sys\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.677788 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.677756 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jgxh\" (UniqueName: \"kubernetes.io/projected/d450c4c1-e295-479c-9064-1fec8454e2e1-kube-api-access-9jgxh\") pod \"perf-node-gather-daemonset-gtvwz\" (UID: \"d450c4c1-e295-479c-9064-1fec8454e2e1\") " pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.762652 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.762556 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:30.891724 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.891699 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz"] Jul 06 02:00:30.893876 ip-10-0-134-152 kubenswrapper[2571]: W0706 02:00:30.893848 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd450c4c1_e295_479c_9064_1fec8454e2e1.slice/crio-438501e7eb31362c9c891c639355552e24a8e3e1c3525bec06bbf436f5884194 WatchSource:0}: Error finding container 438501e7eb31362c9c891c639355552e24a8e3e1c3525bec06bbf436f5884194: Status 404 returned error can't find the container with id 438501e7eb31362c9c891c639355552e24a8e3e1c3525bec06bbf436f5884194 Jul 06 02:00:30.962767 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:30.962741 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-wwvrf_12a60772-75d1-4849-845e-2640af63efa9/volume-data-source-validator/0.log" Jul 06 02:00:31.461389 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:31.461354 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" event={"ID":"d450c4c1-e295-479c-9064-1fec8454e2e1","Type":"ContainerStarted","Data":"d623638b1478f1b535d9af69e86d46ee0600a090e360ff781cdf798f1a96ff2a"} Jul 06 02:00:31.461570 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:31.461412 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:31.461570 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:31.461434 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" event={"ID":"d450c4c1-e295-479c-9064-1fec8454e2e1","Type":"ContainerStarted","Data":"438501e7eb31362c9c891c639355552e24a8e3e1c3525bec06bbf436f5884194"} Jul 06 02:00:31.478262 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:31.478215 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" podStartSLOduration=1.478199416 podStartE2EDuration="1.478199416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:00:31.476657164 +0000 UTC m=+2422.899460219" watchObservedRunningTime="2026-07-06 02:00:31.478199416 +0000 UTC m=+2422.901002469" Jul 06 02:00:31.993165 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:31.993129 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gslcw_e442a372-ef1f-45de-960f-31b7416fd01b/dns/0.log" Jul 06 02:00:32.013184 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:32.013155 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gslcw_e442a372-ef1f-45de-960f-31b7416fd01b/kube-rbac-proxy/0.log" Jul 06 02:00:32.147278 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:32.147245 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qjs8x_6d24bbed-1fab-473d-928a-e76a74b4780c/dns-node-resolver/0.log" Jul 06 02:00:32.758109 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:32.758077 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ncsk8_7cecfe8c-a378-41ca-9656-bceebfd3f60a/node-ca/0.log" Jul 06 02:00:33.657142 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:33.657097 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dqjdg_fc10789b-4990-4cb3-b629-07e8fd506dbb/istio-proxy/0.log" Jul 06 02:00:33.761101 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:33.761069 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vdpzn_9b42bdba-14c6-48c7-900f-821da4248364/discovery/0.log" Jul 06 02:00:33.835216 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:33.835181 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/0.log" Jul 06 02:00:33.863988 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:33.863927 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/1.log" Jul 06 02:00:33.896893 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:33.896858 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2tjjf_bfa6daad-1ab3-4012-b6b7-309ed5446513/payload-pre-processing/0.log" Jul 06 02:00:33.970048 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:33.970018 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6c8bb4bf-h6nxl_df104202-ae4e-4716-869d-ac91e7b6c754/router/0.log" Jul 06 02:00:34.651569 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:34.651537 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fltxm_4b7146d6-1469-40b2-9631-295badf7e234/serve-healthcheck-canary/0.log" Jul 06 02:00:35.094033 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:35.094005 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7f6bq_8703fecb-fd27-4224-999b-fb548d74d493/insights-operator/0.log" Jul 06 02:00:35.177884 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:35.177858 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rh97s_4ed4f8bd-8c5c-4c14-ab51-a8479c04508d/kube-rbac-proxy/0.log" Jul 06 02:00:35.197167 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:35.197139 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rh97s_4ed4f8bd-8c5c-4c14-ab51-a8479c04508d/exporter/0.log" Jul 06 02:00:35.216459 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:35.216434 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rh97s_4ed4f8bd-8c5c-4c14-ab51-a8479c04508d/extractor/0.log" Jul 06 02:00:37.475611 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:37.475582 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hqwmc/perf-node-gather-daemonset-gtvwz" Jul 06 02:00:37.619567 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:37.619542 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721705-l7zkp_a629ae47-8473-4c52-8ebb-d93268921a19/cleanup/0.log" Jul 06 02:00:37.902713 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:37.902621 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d8fbf9755-bx6zd_052c5c48-1883-4235-97fe-8c4393b1e12c/manager/0.log" Jul 06 02:00:37.921805 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:37.921776 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d8fbf9755-bx6zd_052c5c48-1883-4235-97fe-8c4393b1e12c/copy-manifests/0.log" Jul 06 02:00:39.341492 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:39.341462 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76dc9d4b5b-5lr7h_c9f8fa13-d3c0-4b2f-af07-5e1addd2b697/manager/0.log" Jul 06 02:00:40.088627 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:40.088595 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dqjdg_fc10789b-4990-4cb3-b629-07e8fd506dbb/istio-proxy/0.log" Jul 06 02:00:40.197545 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:40.197515 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vdpzn_9b42bdba-14c6-48c7-900f-821da4248364/discovery/0.log" Jul 06 02:00:40.244177 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:40.244153 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/0.log" Jul 06 02:00:40.271200 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:40.271168 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/1.log" Jul 06 02:00:40.291319 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:40.291295 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2tjjf_bfa6daad-1ab3-4012-b6b7-309ed5446513/payload-pre-processing/0.log" Jul 06 02:00:40.344725 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:40.344643 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6c8bb4bf-h6nxl_df104202-ae4e-4716-869d-ac91e7b6c754/router/0.log" Jul 06 02:00:41.704254 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:41.704200 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dqjdg_fc10789b-4990-4cb3-b629-07e8fd506dbb/istio-proxy/0.log" Jul 06 02:00:41.806539 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:41.806503 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vdpzn_9b42bdba-14c6-48c7-900f-821da4248364/discovery/0.log" Jul 06 02:00:41.872196 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:41.872167 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/0.log" Jul 06 02:00:41.898351 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:41.898318 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58rf4_57e4c71c-d285-47ec-a6c3-84062fdfc9f8/istio-proxy/1.log" Jul 06 02:00:41.933843 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:41.933813 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2tjjf_bfa6daad-1ab3-4012-b6b7-309ed5446513/payload-pre-processing/0.log" Jul 06 02:00:41.997792 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:41.997711 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6c8bb4bf-h6nxl_df104202-ae4e-4716-869d-ac91e7b6c754/router/0.log" Jul 06 02:00:44.792065 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:44.792008 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-b2jwq_5b431f0d-3a72-41ff-bf8c-f0c89b6ba671/kube-storage-version-migrator-operator/0.log" Jul 06 02:00:46.151822 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.151795 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/kube-multus-additional-cni-plugins/0.log" Jul 06 02:00:46.170824 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.170802 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/egress-router-binary-copy/0.log" Jul 06 02:00:46.190192 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.190171 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/cni-plugins/0.log" Jul 06 02:00:46.213542 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.213517 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/bond-cni-plugin/0.log" Jul 06 02:00:46.233414 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.233385 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/routeoverride-cni/0.log" Jul 06 02:00:46.253444 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.253421 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/whereabouts-cni-bincopy/0.log" Jul 06 02:00:46.272016 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.271985 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jgv2_30197e12-318a-4318-98f4-f6e76de8f3db/whereabouts-cni/0.log" Jul 06 02:00:46.306406 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.306380 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qqxp2_6326da57-2656-4351-b417-b45cf45a621c/kube-multus/0.log" Jul 06 02:00:46.407091 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.407016 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jv4mv_f387a6c0-87c0-406d-a2c4-1e0c5081ad57/network-metrics-daemon/0.log" Jul 06 02:00:46.426285 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:46.426257 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jv4mv_f387a6c0-87c0-406d-a2c4-1e0c5081ad57/kube-rbac-proxy/0.log" Jul 06 02:00:47.696178 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.696133 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-controller/0.log" Jul 06 02:00:47.713354 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.713323 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/0.log" Jul 06 02:00:47.713354 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.713340 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovn-acl-logging/1.log" Jul 06 02:00:47.732410 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.732337 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/kube-rbac-proxy-node/0.log" Jul 06 02:00:47.753142 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.753120 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 02:00:47.773256 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.773219 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/northd/0.log" Jul 06 02:00:47.792278 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.792250 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/nbdb/0.log" Jul 06 02:00:47.812157 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.812132 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/sbdb/0.log" Jul 06 02:00:47.861028 ip-10-0-134-152 kubenswrapper[2571]: I0706 02:00:47.860996 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xlzn7_44e5dc17-dc36-46ba-b633-32def067e505/ovnkube-controller/0.log"